-- Logs begin at Wed 2022-08-31 18:26:40 UTC, end at Wed 2022-08-31 19:49:34 UTC. -- Aug 31 19:06:14.616572 dv-cinder-835384-26-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 19:06:14.625859 dv-cinder-835384-26-smb devstack@keystone.service[81637]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:06:14 2022] *** Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: nodename: dv-cinder-835384-26-smb Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: machine: x86_64 Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: clock source: unix Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: pcre jit disabled Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: detected number of CPU cores: 4 Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: current working directory: / Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:06:14.629384 dv-cinder-835384-26-smb devstack@keystone.service[81637]: your processes number limit is 47680 Aug 31 19:06:14.630007 dv-cinder-835384-26-smb devstack@keystone.service[81637]: your memory page size is 4096 bytes Aug 31 19:06:14.630007 dv-cinder-835384-26-smb devstack@keystone.service[81637]: detected max file descriptor number: 2048 Aug 31 19:06:14.630007 dv-cinder-835384-26-smb devstack@keystone.service[81637]: lock engine: pthread robust mutexes Aug 31 19:06:14.630007 dv-cinder-835384-26-smb devstack@keystone.service[81637]: thunder lock: enabled Aug 31 19:06:14.630007 dv-cinder-835384-26-smb devstack@keystone.service[81637]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 19:06:14.630007 dv-cinder-835384-26-smb devstack@keystone.service[81637]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:06:14.669186 dv-cinder-835384-26-smb devstack@keystone.service[81637]: Python main interpreter initialized at 0x55b6589809c0 Aug 31 19:06:14.669186 dv-cinder-835384-26-smb devstack@keystone.service[81637]: python threads support enabled Aug 31 19:06:14.669186 dv-cinder-835384-26-smb devstack@keystone.service[81637]: your server socket listen backlog is limited to 100 connections Aug 31 19:06:14.669186 dv-cinder-835384-26-smb devstack@keystone.service[81637]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:06:14.669524 dv-cinder-835384-26-smb devstack@keystone.service[81637]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:06:14.669600 dv-cinder-835384-26-smb devstack@keystone.service[81637]: *** Operational MODE: preforking *** Aug 31 19:06:14.669865 dv-cinder-835384-26-smb devstack@keystone.service[81637]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:06:14.669865 dv-cinder-835384-26-smb devstack@keystone.service[81637]: spawned uWSGI master process (pid: 81637) Aug 31 19:06:14.670066 dv-cinder-835384-26-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 19:06:14.670872 dv-cinder-835384-26-smb devstack@keystone.service[81637]: spawned uWSGI worker 1 (pid: 81649, cores: 1) Aug 31 19:06:14.670966 dv-cinder-835384-26-smb devstack@keystone.service[81637]: spawned uWSGI worker 2 (pid: 81650, cores: 1) Aug 31 19:06:14.672407 dv-cinder-835384-26-smb devstack@keystone.service[81637]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:06:19.025340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:19.025340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: from cryptography.utils import int_from_bytes Aug 31 19:06:19.026225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:19.026225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: from cryptography.utils import int_from_bytes Aug 31 19:06:19.026339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:19.026339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: from cryptography.utils import int_from_bytes Aug 31 19:06:19.026339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:19.026339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: from cryptography.utils import int_from_bytes Aug 31 19:06:19.076470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] command line args: [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ================================================================================ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] admin_token = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config_dir = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.079998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.080415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:06:19.080483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config_source = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.080546 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:06:19.080614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] debug = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.080678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] command line args: [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:06:19.081058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:06:19.081375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ================================================================================ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:06:19.081496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] admin_token = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config_dir = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config_source = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.081975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] debug = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_config_append = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_dir = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_config_append = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.082966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_dir = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.083965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] publish_errors = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.084931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.085968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] standard_threads = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] publish_errors = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_journal = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.086937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_json = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_stderr = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_syslog = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] standard_threads = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.087759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.087867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.088001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.088085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.088293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_journal = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.088919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.089065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_json = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.089151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.089249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_stderr = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.089384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.089468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_syslog = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.089629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.089711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:19.089884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.089969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.090945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.091930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.092951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.093929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.094907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.095894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.096859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.097015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.097096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.097269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.097353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.097655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.097809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.098901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.099957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.100940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101778 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.101856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.102972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.103986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.104777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.108628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.108737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.108868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.108954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.109901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110899 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.110967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.111949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.112973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.113963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.external = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.114974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.password = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.token = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.115927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.external = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.116920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.password = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.token = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.117989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.118957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.119969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.120960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.121937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.122996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.123990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.124969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.125970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.126895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.127841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.128847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.129983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.130951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.131936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.132902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.133897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.134870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.135559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.135642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.135807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.135884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.136906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.137990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.138965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.139922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.140906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.141877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.142994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.143962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.144823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.145076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.148734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.148734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.148952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.149995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.150672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.151968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.152938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.153996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.154978 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.155968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.156988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.157959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.158908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.159900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.160897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.161912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.162889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.163852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.164854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.165831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.166050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.166360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.166450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.166533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:06:19.166607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.166763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.167006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.167249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.167501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.167744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.167995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.168237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.168490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.168733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.169013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.169253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.169498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.169738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:19.169914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:06:19.195685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.195919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.196153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.199305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.199544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.199778 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.205198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.209229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.233990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.234223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.236087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.236323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.292428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.292584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.341710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.341940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.343465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.343706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.503971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.504198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.504422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.504641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.504890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.505113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.505943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.506181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.506407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.506628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.506847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.507067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.533863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.534948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.535030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.535166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.535300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.535390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.546318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.547287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.567547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.567779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.567963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.568965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.569230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.569442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:19.585853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.586068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:19.586151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.586288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:19.586414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.586632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.586714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:19.586833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:19.586915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.587149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.587362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.587443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.587628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.587708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.587892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.588683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.597947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.598049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.598182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.598266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.598466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.598550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.598739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.599029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.606084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.609938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.610028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.610028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.610252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.610930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.611101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.611184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.611392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.611474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.611660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.611742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.612015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.612297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.612572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.634928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.636409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.636696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.636888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.638728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.639019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.641570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.641861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.642209 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.644326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.644845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.645219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.648795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.649119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.652193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.667428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.667523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.667523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.667523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.667523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.667523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.667808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.667883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.667959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.668357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.673344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.673631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.677418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.680449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.680744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.685036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.688072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.688430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.691187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.691312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.691488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.691771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.692052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.692330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.692712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.695478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.698656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.698963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.703336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.706943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.708741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.709054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.709324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.709589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.710117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.710437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.710730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.711018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.711315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.711619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.716783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.718446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.719977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.720320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.723011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.723352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.723566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.723859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.724149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.728265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.728618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.729509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.729789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.735968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.736255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.736670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.736838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.737003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.737123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.737403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.737682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.738839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.740447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.740733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.743730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.744031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.744333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.744663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.744982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.753164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.756150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.756464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.756758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.757073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.757362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.757672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.757954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.758249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.759038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.761021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.762485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.762780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.763073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.770114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.771588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.774435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.774541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.774754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.775041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.775330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.778113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.787640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.787640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.787778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.787846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.787932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.788016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.788092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.788165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.791259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.791345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.791570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.791865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.792146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.792430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.792712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.792892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.793016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.793284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.793570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.793840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.794164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.794383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.794659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.794916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.795910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.796208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.796502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.796819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.804961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.805258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.805547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.812539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:19.812844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.813143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.813428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.813716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.813994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.814278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.814558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.814948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.815228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.815516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.815787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.816059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.816345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:19.829050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b6589809c0 pid: 81649 (default app) Aug 31 19:06:19.832796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f8d80-8b7c-4a1f-998f-6070037dc3fc None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:19.833109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f8d80-8b7c-4a1f-998f-6070037dc3fc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:19.835715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f8d80-8b7c-4a1f-998f-6070037dc3fc None None] PATH_INFO: `/v3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:19.837511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Wed Aug 31 19:06:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:19.852038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b6589809c0 pid: 81650 (default app) Aug 31 19:06:27.753510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:27.754040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:27.754040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:27.755378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:27.763454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:27.763924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:27.764017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:27.834593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: INFO dbcounter [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] Registered counter for database keystone Aug 31 19:06:27.855298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:06:27.861446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writer thread running {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:06:28.041830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG passlib.handlers.bcrypt [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81650) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 19:06:28.042213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG passlib.handlers.bcrypt [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81650) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 19:06:28.100635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:28.102220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:28.231844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1/3] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 19:06:28.724739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:28.795874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: INFO dbcounter [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] Registered counter for database keystone Aug 31 19:06:28.815386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG oslo_db.sqlalchemy.engines [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:06:28.821593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writer thread running {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:06:28.943067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408f88f-239e-403d-ac4d-9f554ec8b3e1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:28.947419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:28.948052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:28.948339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:28.948641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:28.957073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:29.008481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING keystone.common.rbac_enforcer.enforcer [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 19:06:29.008871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcf4e2-aa71-4819-b50f-67f6fd75132a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:29.018294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 3/4] 10.222.0.76 () {58 vars in 1324 bytes} [Wed Aug 31 19:06:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:06:29.024219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:29.038652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb30435-853c-4571-9ffb-9c5a5b7a65cb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:29.043576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:29.044676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:29.044999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:29.045276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] PATH_INFO: `/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:29.046796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] RBAC: Authorizing `identity:get_project(project_id=c50ebd1d38a64d4a92701ba8958dbdd4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:29.099364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 19:06:29.099718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63ec0-1f5a-4226-88db-5218a22e934e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:29.104922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 2/5] 10.222.0.76 () {56 vars in 1207 bytes} [Wed Aug 31 19:06:29 2022] GET /identity/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:31.030561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536c29-0f92-49f9-aeda-f54975d57f2c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:31.031072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536c29-0f92-49f9-aeda-f54975d57f2c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:31.031159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536c29-0f92-49f9-aeda-f54975d57f2c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:31.035175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 4/6] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:31.040541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:31.041475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:31.041655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:31.062143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:31.063669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:31.071528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 3/7] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 19:06:31.344290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536c29-0f92-49f9-aeda-f54975d57f2c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:31.356394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536c29-0f92-49f9-aeda-f54975d57f2c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:31.360620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d337ae4-f376-4023-8df1-1e405b522c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:31.361249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d337ae4-f376-4023-8df1-1e405b522c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:31.361530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d337ae4-f376-4023-8df1-1e405b522c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:31.361805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d337ae4-f376-4023-8df1-1e405b522c60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:31.369844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d337ae4-f376-4023-8df1-1e405b522c60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:31.371616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d337ae4-f376-4023-8df1-1e405b522c60 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:31.380144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 5/8] 10.222.0.76 () {58 vars in 1324 bytes} [Wed Aug 31 19:06:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:06:31.385582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:31.395229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae6b36-6940-4d6f-97a2-b0ce37d81959 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:31.399682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aba2b-932b-4c59-933f-ef84a38266ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:31.400308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aba2b-932b-4c59-933f-ef84a38266ee admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:31.400593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aba2b-932b-4c59-933f-ef84a38266ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:31.400908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aba2b-932b-4c59-933f-ef84a38266ee admin admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:31.402231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aba2b-932b-4c59-933f-ef84a38266ee admin admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:31.404064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aba2b-932b-4c59-933f-ef84a38266ee admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:31.405624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 4/9] 10.222.0.76 () {56 vars in 1198 bytes} [Wed Aug 31 19:06:31 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:33.369962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a68f1-e5ad-4f64-b0d1-ad5746f53f93 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.370489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a68f1-e5ad-4f64-b0d1-ad5746f53f93 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.370627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a68f1-e5ad-4f64-b0d1-ad5746f53f93 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.372014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:33.377460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.377876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.378012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.396230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:33.397452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:33.409041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea14e-cf8f-48d2-b40c-3d400a8a242f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.409333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea14e-cf8f-48d2-b40c-3d400a8a242f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.409614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea14e-cf8f-48d2-b40c-3d400a8a242f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.410996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 7/11] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:33.416011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.416451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.416732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.458350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG passlib.handlers.bcrypt [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81649) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 19:06:33.458752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG passlib.handlers.bcrypt [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81649) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 19:06:33.478392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 5/12] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:06:33.507676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:33.509364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:33.611305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 8/13] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:06:33.746222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.769634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:33.851229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e956a20-d5bc-4e24-a725-5982d4a6f480 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.879904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.884435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:33.885105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.885399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.885672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.897011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:33.906197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:33.907262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:33.908030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 6/14] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:33.913155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.982244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7e4b-f626-469e-95e1-0a3599261e41 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.985651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:33.999424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:34.017136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11b50-0ae8-40e3-a8c4-2db60b8ed057 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:34.021930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.022836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.023123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.023405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.051343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.051954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.052238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.052519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.053219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:34.053529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.054956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.066984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 7/15] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:34.073151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:34.092616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.094174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.171869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e7a8b-9818-4e36-a355-d6331ae3adcb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:34.191984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 9/16] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:06:34.197581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:34.201520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:34.209333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.215112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.215112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.215112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.215112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.215112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.215112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 8/17] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:34 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:34.221319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:34.236228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:34.301685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc56c69-ddde-4af2-9184-c28a6ac28dd0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:34.321362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b544-fe3a-4928-84b3-7acee511dc03 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:34.335808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.336665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.336982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.337265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.354946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.355563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.355763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.355854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.356097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.357231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.357342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.358670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.360286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 9/18] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:34.366127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:34.376022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:34.377294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:34.378081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:34.378081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:34.378081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:34.378081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 10/19] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:34.384095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:34.439328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:34.448287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:34.467651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb869-4d93-46ba-8bd5-2aa18b3f7fd4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:34.485297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127319d-07c5-44f7-8b84-da1ac51c894e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:34.501435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.502042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.502331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.502604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.503323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.domain.id=default, user.id=2bdffc3106dc45bebf612cd563b7955e) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:34.503633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.505114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef57f90-3d58-449a-a81e-1db41475e9fd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.512391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 10/20] 10.222.0.76 () {56 vars in 1322 bytes} [Wed Aug 31 19:06:34 2022] GET /identity/v3/role_assignments?user.id=2bdffc3106dc45bebf612cd563b7955e&scope.domain.id=default&role.id=a3733baec72d443ab044f15928e9f85d => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:34.519851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:34.520493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:34.520866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:34.521120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:34.521804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:34.522114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:34.523557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52017-7900-47e3-b4bc-fb514510a676 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:34.544321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 11/21] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:36.740988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49829-ffa6-4a77-9072-10a99387adab None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.741725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49829-ffa6-4a77-9072-10a99387adab None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.741725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49829-ffa6-4a77-9072-10a99387adab None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.742872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 11/22] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:36.748950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706426-44bc-49c4-b146-55a9bb7393d3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.749728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706426-44bc-49c4-b146-55a9bb7393d3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.750167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706426-44bc-49c4-b146-55a9bb7393d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.777771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-47706426-44bc-49c4-b146-55a9bb7393d3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:36.779236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-47706426-44bc-49c4-b146-55a9bb7393d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:36.836084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654913-1e92-4aa1-81b7-0188c849240e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.836397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654913-1e92-4aa1-81b7-0188c849240e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.836634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654913-1e92-4aa1-81b7-0188c849240e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.838032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 12/23] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:36.851505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182414ea-bc3d-4b8e-8a2b-a296e8f72e8d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.851812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182414ea-bc3d-4b8e-8a2b-a296e8f72e8d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.852047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182414ea-bc3d-4b8e-8a2b-a296e8f72e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.889711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-182414ea-bc3d-4b8e-8a2b-a296e8f72e8d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:36.890929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-182414ea-bc3d-4b8e-8a2b-a296e8f72e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:36.899396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 12/24] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:36.988447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 13/25] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 19:06:37.043060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6d39-1060-4cc5-80a3-d542d8592a7e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:37.043408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6d39-1060-4cc5-80a3-d542d8592a7e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:37.043626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6d39-1060-4cc5-80a3-d542d8592a7e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:37.045057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 13/26] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:37.053192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:37.053510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:37.053762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:37.077461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:37.078646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:37.164161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 14/27] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:37.298299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6d39-1060-4cc5-80a3-d542d8592a7e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:37.354698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:37.383422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:37.390857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:37.441028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6d39-1060-4cc5-80a3-d542d8592a7e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:37.514023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:37.514673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:37.514959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:37.515237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:37.530170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:37.531666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:37.563935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:37.564993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:37.565806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:37.565806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:37.565806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:37.565806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 14/28] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:37.566019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:37.575988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf269a-db64-41d6-a5ab-3eb9418fcb17 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:37.652767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:37.653469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:37.653813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:37.654087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:37.678395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:37.687092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:37.689108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:37.690996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:37.696911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 15/29] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:37.696911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:37.769961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:37.775626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f66d-85a6-411c-a8e8-eda0f09d20e8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:37.801337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:37.830475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1a10-054c-4bfc-bb39-6fe768a9447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:37.831910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1a10-054c-4bfc-bb39-6fe768a9447c None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:37.832418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1a10-054c-4bfc-bb39-6fe768a9447c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:37.832933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1a10-054c-4bfc-bb39-6fe768a9447c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:37.833890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc1a10-054c-4bfc-bb39-6fe768a9447c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:37.835524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc1a10-054c-4bfc-bb39-6fe768a9447c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:37.846735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4204-e1b9-48f9-b48c-cfaaad2e635c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:37.884501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:37.885367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:37.888010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:37.888010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:37.888010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:37.888010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:37.888471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:37.910998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 16/30] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:37.910998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:38.024999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4469be-9363-42b4-8981-c06a80b6af51 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:38.059229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:38.070208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:38.077803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.077803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.077803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.077803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:38.077803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:38.077803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2589a0-0316-4265-982e-b0d8980cbc23 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:38.082742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 17/31] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:38.084219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fafbeb-1116-4498-8ee3-9c7ed7731f5d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.084513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fafbeb-1116-4498-8ee3-9c7ed7731f5d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.084796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fafbeb-1116-4498-8ee3-9c7ed7731f5d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.086047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 18/32] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:38.086902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fafbeb-1116-4498-8ee3-9c7ed7731f5d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:38.092913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 15/33] 10.222.0.76 () {60 vars in 1131 bytes} [Wed Aug 31 19:06:37 2022] POST /identity/v3/roles => generated 219 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:38.094538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792f23-8b54-4895-bce7-1be95e8b762e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.094910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792f23-8b54-4895-bce7-1be95e8b762e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.095268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792f23-8b54-4895-bce7-1be95e8b762e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.096667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 16/34] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:38.102464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792f23-8b54-4895-bce7-1be95e8b762e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:38.229547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792f23-8b54-4895-bce7-1be95e8b762e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:38.241774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fafbeb-1116-4498-8ee3-9c7ed7731f5d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:38.275609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172535e-0498-47de-ad13-d725c3c6c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:38.276281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172535e-0498-47de-ad13-d725c3c6c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.276656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172535e-0498-47de-ad13-d725c3c6c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.277029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172535e-0498-47de-ad13-d725c3c6c3a2 None admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.279498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172535e-0498-47de-ad13-d725c3c6c3a2 None admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:38.281395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172535e-0498-47de-ad13-d725c3c6c3a2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:38.283256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 17/35] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:38 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:38.284686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93abd6-0299-42df-9580-256a9185a36b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.285144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93abd6-0299-42df-9580-256a9185a36b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.285580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93abd6-0299-42df-9580-256a9185a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.286515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b7de5-dcc0-49c2-a161-f0a8d0c9723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:38.287387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7de5-dcc0-49c2-a161-f0a8d0c9723c None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.287876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7de5-dcc0-49c2-a161-f0a8d0c9723c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7de5-dcc0-49c2-a161-f0a8d0c9723c None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.289451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b7de5-dcc0-49c2-a161-f0a8d0c9723c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:38.291529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b7de5-dcc0-49c2-a161-f0a8d0c9723c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:38.305793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-af93abd6-0299-42df-9580-256a9185a36b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:38.308156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-af93abd6-0299-42df-9580-256a9185a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:38.332002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:38.380444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 18/36] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:38.381787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.382080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.382381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.401031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:38.402229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:38.476724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 19/37] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:38.478830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:38.537627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 19/38] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/projects => generated 301 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:38.546967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421c68-0050-423c-a519-d53e848bb6ea None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.547264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421c68-0050-423c-a519-d53e848bb6ea None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.547547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421c68-0050-423c-a519-d53e848bb6ea None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.553254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 20/39] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:38.560013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.561999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.562543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.604840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:38.611784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:38.619400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:38.656939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d42417-68d0-4517-a0a9-7ad286786a24 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:38.659733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:38.704703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 21/40] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:06:38.727745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:38.729250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.729536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.729866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.733160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:38.734728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:38.736549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 20/41] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:38.736823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:38.745748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:38.862840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204e75e-7f70-4244-bd09-100daf671169 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:38.881699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524d050-0654-416f-97e2-168f98510d89 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:38.903971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:38.904593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.904907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.905193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.905929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:38.907537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:38.918271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:38.918942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.919230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.919515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] PATH_INFO: `/v3/domains/default/users/2bdffc3106dc45bebf612cd563b7955e/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.921520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2bdffc3106dc45bebf612cd563b7955e, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:38.923038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:38.998900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1131 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:06:38.999942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:39.048268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 21/43] 10.222.0.76 () {58 vars in 1361 bytes} [Wed Aug 31 19:06:38 2022] PUT /identity/v3/domains/default/users/2bdffc3106dc45bebf612cd563b7955e/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:39.049220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:39.088579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:39.154119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:39.196599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90db9-e75c-4fd8-98f7-ccf88f886a96 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:39.244526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:39.245490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:39.245790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:39.246072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:39.247373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:39.248945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:39.250717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 22/44] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:39.256399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:39.259488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e2ae-d7f7-4809-935e-03f15a78d6e3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:39.297435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cb089-fab5-43cc-9df5-5ea4b3d55fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:39.298058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb089-fab5-43cc-9df5-5ea4b3d55fe7 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:39.298347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb089-fab5-43cc-9df5-5ea4b3d55fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:39.299145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb089-fab5-43cc-9df5-5ea4b3d55fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:39.299834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cb089-fab5-43cc-9df5-5ea4b3d55fe7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:39.301754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cb089-fab5-43cc-9df5-5ea4b3d55fe7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:39.342450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:39.360211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e14ea-f88d-44d8-9d6f-a00078852034 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:39.382157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 23/45] 10.222.0.76 () {60 vars in 1131 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/roles => generated 223 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:39.394753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb300a-7f54-4ced-a9b2-108e146bcf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:39.395692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb300a-7f54-4ced-a9b2-108e146bcf08 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:39.396138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb300a-7f54-4ced-a9b2-108e146bcf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:39.396564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb300a-7f54-4ced-a9b2-108e146bcf08 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:39.397564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb300a-7f54-4ced-a9b2-108e146bcf08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:39.399375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb300a-7f54-4ced-a9b2-108e146bcf08 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:39.534531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:06:39 2022] POST /identity/v3/projects => generated 312 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:06:41.041538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd68a5-bacc-41b4-897f-24ca60caa9c5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.042076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd68a5-bacc-41b4-897f-24ca60caa9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.042076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd68a5-bacc-41b4-897f-24ca60caa9c5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.043436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 24/47] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:41.048662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190013-9008-4512-98f9-6fec90a3fff3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.049089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190013-9008-4512-98f9-6fec90a3fff3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.049279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190013-9008-4512-98f9-6fec90a3fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.067256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-82190013-9008-4512-98f9-6fec90a3fff3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:41.068465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-82190013-9008-4512-98f9-6fec90a3fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:41.134898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 24/48] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:41.407233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd68a5-bacc-41b4-897f-24ca60caa9c5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.437025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a0e1-944d-43c5-b1ea-7a99593084a4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.437426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a0e1-944d-43c5-b1ea-7a99593084a4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.437780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a0e1-944d-43c5-b1ea-7a99593084a4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.439193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 25/49] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:41.443966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.444256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.444532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.463079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:41.464284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:41.501124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:41.514106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd68a5-bacc-41b4-897f-24ca60caa9c5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:41.522282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:41.530181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 26/50] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:06:41.552637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:41.553314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.553603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.553881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.563818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:41.568636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:41.569664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:41.570563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 25/51] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:41.576182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.674155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19196a-67a1-4ec6-a6f5-81cf942bfdf5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:41.707959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:41.708550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.708860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.709142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.709807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:41.710112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:41.711496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:41.723039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 27/52] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:41.728611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.801786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.831943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3db33-7a95-4b11-a96e-99eca7fc51bb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:41.868890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:41.869548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.869837 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.870160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.871367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:41.872913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:41.874571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:41 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:41.880366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.899399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:41.961117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:41.982555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b3aa-f3d4-4eb7-a197-0e0099d9a3e9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:42.005007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7fa01-c593-427f-a94d-daae5d792503 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:42.015870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:42.016499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:42.016782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:42.017093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:42.018224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:42.019701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:42.021294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 27/54] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:42.027648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:42.038377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:42.039099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:42.039312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:42.039592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:42.041343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:42.042802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:42.044377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 28/55] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:42.049827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:42.111912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:42.126907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82647f-4779-4b55-b504-c773fe51f960 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:42.147634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc49f-35d3-4f08-8704-bd4d3492e7dd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:42.160888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:42.161491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:42.161773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:42.162054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:42.162777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.domain.id=default, user.id=2bdffc3106dc45bebf612cd563b7955e) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:42.163089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:42.164661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8023116-073e-487b-91ee-3e07451bf3ca None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:42.171485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 28/56] 10.222.0.76 () {56 vars in 1322 bytes} [Wed Aug 31 19:06:42 2022] GET /identity/v3/role_assignments?user.id=2bdffc3106dc45bebf612cd563b7955e&scope.domain.id=default&role.id=a3733baec72d443ab044f15928e9f85d => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:42.172930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:42.182598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedfb84-1882-410d-8b77-ee5a4bad19f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:42.183248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedfb84-1882-410d-8b77-ee5a4bad19f7 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:42.183533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedfb84-1882-410d-8b77-ee5a4bad19f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:42.183815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedfb84-1882-410d-8b77-ee5a4bad19f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:42.184511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedfb84-1882-410d-8b77-ee5a4bad19f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:42.186053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedfb84-1882-410d-8b77-ee5a4bad19f7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:42.298285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 29/57] 10.222.0.76 () {60 vars in 1140 bytes} [Wed Aug 31 19:06:42 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:06:44.203773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa55cd8-8122-49d3-8707-b78b6d2dab13 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:44.204337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa55cd8-8122-49d3-8707-b78b6d2dab13 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:44.204337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa55cd8-8122-49d3-8707-b78b6d2dab13 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:44.205977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 29/58] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:44.211034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:44.211403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:44.211608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:44.230396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:44.231611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:44.296636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 30/59] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:44.564594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa55cd8-8122-49d3-8707-b78b6d2dab13 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:44.663230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa55cd8-8122-49d3-8707-b78b6d2dab13 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:44.696327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552670-c94f-40db-9d1e-4c30a07e0385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:44.697497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552670-c94f-40db-9d1e-4c30a07e0385 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:44.697783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552670-c94f-40db-9d1e-4c30a07e0385 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:44.698061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552670-c94f-40db-9d1e-4c30a07e0385 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:44.699172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a552670-c94f-40db-9d1e-4c30a07e0385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:44.700621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a552670-c94f-40db-9d1e-4c30a07e0385 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:44.702201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 30/60] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:44.707879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:44.801674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f49f2-d3e8-46ea-b9b7-234329e78fdb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:44.808491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:44.833954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f92760-e4b5-4317-a085-1b14c97e214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:44.834540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f92760-e4b5-4317-a085-1b14c97e214f None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:44.834822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f92760-e4b5-4317-a085-1b14c97e214f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:44.835095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f92760-e4b5-4317-a085-1b14c97e214f None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:44.835734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f92760-e4b5-4317-a085-1b14c97e214f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:44.837339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f92760-e4b5-4317-a085-1b14c97e214f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:44.958133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 31/61] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:06:44 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:47.850785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a6b3-d308-4b94-8d64-f690b31a6ac0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.851845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a6b3-d308-4b94-8d64-f690b31a6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.852370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a6b3-d308-4b94-8d64-f690b31a6ac0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.854742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 31/62] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:47.859864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5abcb1-c4d8-4bd9-9c40-ed73ccb436ce None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.860725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5abcb1-c4d8-4bd9-9c40-ed73ccb436ce None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.861245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5abcb1-c4d8-4bd9-9c40-ed73ccb436ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.889822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bb5abcb1-c4d8-4bd9-9c40-ed73ccb436ce None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:47.891397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bb5abcb1-c4d8-4bd9-9c40-ed73ccb436ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:47.990198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 32/63] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:48.202203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dc24-0ca2-4d78-a41f-706124befbb7 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.202865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dc24-0ca2-4d78-a41f-706124befbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.203363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dc24-0ca2-4d78-a41f-706124befbb7 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.205271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 32/64] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:48.212858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2966a-5fbf-498e-ba7c-483fc55fd1f7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.213450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2966a-5fbf-498e-ba7c-483fc55fd1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.213942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2966a-5fbf-498e-ba7c-483fc55fd1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.249823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-81f2966a-5fbf-498e-ba7c-483fc55fd1f7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:48.251395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-81f2966a-5fbf-498e-ba7c-483fc55fd1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:48.343136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 33/65] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:06:48.371490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dc24-0ca2-4d78-a41f-706124befbb7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:48.381180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744641-4b27-4e62-a179-0f73d1961740 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.383455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744641-4b27-4e62-a179-0f73d1961740 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.385207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744641-4b27-4e62-a179-0f73d1961740 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.386802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 34/66] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:48.392118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6ec9-1b95-4061-9233-6c3085027102 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.398197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6ec9-1b95-4061-9233-6c3085027102 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.398197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6ec9-1b95-4061-9233-6c3085027102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.398859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:48.422418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dc0f6ec9-1b95-4061-9233-6c3085027102 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:48.423633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dc0f6ec9-1b95-4061-9233-6c3085027102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:48.465288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:48.530921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 35/67] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:48.532579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de3a1-c6d9-43a8-8ad9-a5f1f252d542 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.533065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de3a1-c6d9-43a8-8ad9-a5f1f252d542 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.533505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de3a1-c6d9-43a8-8ad9-a5f1f252d542 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.534990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 36/68] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:48.539226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dc24-0ca2-4d78-a41f-706124befbb7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:48.550543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.550841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.551122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.571061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:48.572952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:48.577588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:48.578486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.578994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.579479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.591095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:48.596331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:48.597270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:48.598062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:48.600369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 33/69] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:48.606692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:48.689420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 37/70] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:48.690968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:48.745064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:48.770226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273920-67cf-481c-9601-698f7e5ab841 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:48.794321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:48.807306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:48.808343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.808847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.809337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.810216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:48.810728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:48.812361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbb093-023b-4919-a9a2-d929d10b0fdd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:48.815272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a635e-5999-4bbb-b246-22416ab38c31 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:48.821526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 34/71] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:48.823031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd97f-0bf6-4998-900f-d08319c62faa None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.823535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd97f-0bf6-4998-900f-d08319c62faa None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.824018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd97f-0bf6-4998-900f-d08319c62faa None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.825536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 35/72] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:48.830951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cd97f-0bf6-4998-900f-d08319c62faa None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:48.855731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35a46c-2518-4e97-9063-4c86451a4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:48.856385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a46c-2518-4e97-9063-4c86451a4b18 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.856685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a46c-2518-4e97-9063-4c86451a4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.857032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a46c-2518-4e97-9063-4c86451a4b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.870405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35a46c-2518-4e97-9063-4c86451a4b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-9f35a46c-2518-4e97-9063-4c86451a4b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:48.877196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:48.878106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:48.878838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 38/73] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:48.879513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.880302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.880302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.898656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:48.899900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:48.941105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cd97f-0bf6-4998-900f-d08319c62faa None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:48.970295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 39/74] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:48.970991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:48.982872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:48.983824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:48.984116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:48.984402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:48.985739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:48.987583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:48.989336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 36/75] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:48 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:48.990046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:48.999776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.050236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.079496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5333-a065-40bc-ab03-99ddd6f4f242 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.097172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510f8c-5c7d-44ae-a172-3064930ec72a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.115100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.115732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.116022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.116303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.127813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:49.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:49.133528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:06:49.134405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:49.135741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.135741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.135741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.135741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.136006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 40/76] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:06:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:49.136006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.139634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:49.139968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.141602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.151283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 37/77] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.156270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.224177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.241829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4307-62c7-455e-b32b-4d6f1d676832 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.258000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698258e-b912-445c-85b5-348d84eead25 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.271887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.277775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.278422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.279119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.279402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.289375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:49.292240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.292872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.293163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.293440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:49.294233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:49.295030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:49.295784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 41/78] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:49.296399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.361565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.363026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.402215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c371-8ebb-4469-a648-f7bd14e2cec5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.431777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.437095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.437717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.438001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.438279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.438954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:49.439259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.440678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.448711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 42/79] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.449533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.468535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 38/80] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:06:49.469279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.512938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.569324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95947a3-4aa8-4ba9-87f8-70aa561950be None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.576422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec22ee-88cd-4820-a934-65c937260bfa None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.609063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.609867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.610147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.610434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.612224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.612883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.613177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.613449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.614591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.616064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.617676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 39/81] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.618568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.629422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.630930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.632637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 43/82] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.633452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.655244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.729128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733223-f0d1-43c9-9d60-93010ead6e60 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.741817 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f630b-4e3a-43f5-b637-a8c501824ac0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.758710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.776029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.776994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.777488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.777979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.779274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:49.779758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.782415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.783831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.784487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.784774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.785108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.786315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.787786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.789462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 44/83] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.796006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.798210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 40/84] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.799817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.904429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7d3b-3896-48c4-81a1-796cf4491cf0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.921134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:49.924678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2511e8-605d-44d2-a63f-cea20116645b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:49.945706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.946397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.946683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.946962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.948158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.949705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:49.951535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 45/85] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.952221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:49.968178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:49.968879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.969176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.969452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.970122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:49.971649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.003916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.055611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d37ac-be17-490f-8b1b-f4e776e8486b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.080771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 41/86] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:06:49 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:50.081914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.091890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.092557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.092851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.093141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.185953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.187551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.210510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6cbe-7e32-4fbd-bea2-38a3c0e58593 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.249070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.255563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.256221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.264300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.264300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.287711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.316254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 46/87] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:06:50.316526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.343244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.345062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.464338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c510e4-dcf2-44ed-8e22-05d206d22393 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.483532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 42/88] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:06:50.485696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.519401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.520231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.520513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.520944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.522247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.523926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.526007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 47/89] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:50.526609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.558570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.574188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.629419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30816bf-cbeb-4ba5-a59c-700daa20d285 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.654921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234edcb6-6c77-4635-9e1b-e7fa9650002b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.683471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.685056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.685520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.685981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.687789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=2bdffc3106dc45bebf612cd563b7955e) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:50.688511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.690894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.698441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 43/90] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/role_assignments?user.id=2bdffc3106dc45bebf612cd563b7955e&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:50.699629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.700667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.705681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.706274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.706750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.708239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.709999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.712124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 48/91] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:50.713290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.908460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.937825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09caf4-a42e-4e1d-ae50-7c7b5e7e2c3c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.954368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf333a37-4f8f-40d0-bc79-c74552254ec4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.973322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:51.006244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:51.006967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:51.007256 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:51.007569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:51.008932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:51.010417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:51.012151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 44/92] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:51.012970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:51.019307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:51.019940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:51.020225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:51.020501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:51.143351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:51.144892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:51.214413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1602aa9-4510-42c1-a69b-07a9903e8326 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:51.269554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:51.270190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:51.270476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:51.270786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:51.272133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=3f8b36c77511497eb74133de174cd566) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:51.272447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:51.274136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:51.281900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 45/93] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:51 2022] GET /identity/v3/role_assignments?user.id=3f8b36c77511497eb74133de174cd566&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:51.282889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:51.381226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:51.383205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:51.459936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 49/94] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:06:51.465819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:51.494272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034af11d-5ccb-4c1b-8c66-442b243be74b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:51.573510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:51.579264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:51.580107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:51.580587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:51.581587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] RBAC: Adding query filter params (role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=3f8b36c77511497eb74133de174cd566) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:51.582135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:51.583908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:51.600964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 46/95] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:51 2022] GET /identity/v3/role_assignments?user.id=3f8b36c77511497eb74133de174cd566&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:51.662698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24c6b-dffd-40db-8e2f-1b429db4c1c3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:51.721607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a197890-69e6-463b-a21f-db3dc5442a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:51.722647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a197890-69e6-463b-a21f-db3dc5442a80 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:51.723157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a197890-69e6-463b-a21f-db3dc5442a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:51.723663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a197890-69e6-463b-a21f-db3dc5442a80 None admin] PATH_INFO: `/v3/projects/53f56d5320634f8bab3932d0ccb42d2a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:51.725838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a197890-69e6-463b-a21f-db3dc5442a80 None admin] RBAC: Authorizing `identity:get_project(project_id=53f56d5320634f8bab3932d0ccb42d2a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:51.728778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a197890-69e6-463b-a21f-db3dc5442a80 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:51.732069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 50/96] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:51 2022] GET /identity/v3/projects/53f56d5320634f8bab3932d0ccb42d2a => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:51.738779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:51.904984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc73a9-1a0a-4683-a87c-16166c9308c7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:51.926132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:51.949712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:51.950345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:51.950636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:51.950919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:51.951660 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=53f56d5320634f8bab3932d0ccb42d2a, user.id=3f8b36c77511497eb74133de174cd566) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:51.951978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:51.953480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa2aed-87ba-4e0c-abc5-862baf7f5625 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:51.964966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 47/97] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:51 2022] GET /identity/v3/role_assignments?user.id=3f8b36c77511497eb74133de174cd566&scope.project.id=53f56d5320634f8bab3932d0ccb42d2a&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:52.657097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a87d2-afce-4be4-8b78-3da5ecf1d6ef None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:52.657605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a87d2-afce-4be4-8b78-3da5ecf1d6ef None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:52.657695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a87d2-afce-4be4-8b78-3da5ecf1d6ef None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:52.659227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 51/98] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:52.664547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93583-228b-4f64-85e5-5f803e77b690 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:52.665054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93583-228b-4f64-85e5-5f803e77b690 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:52.665743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93583-228b-4f64-85e5-5f803e77b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:52.694309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0ca93583-228b-4f64-85e5-5f803e77b690 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:52.695565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0ca93583-228b-4f64-85e5-5f803e77b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:52.791076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 48/99] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:53.169436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a87d2-afce-4be4-8b78-3da5ecf1d6ef None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.226866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494486da-41f1-478d-8945-8357b946ceff None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.227221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494486da-41f1-478d-8945-8357b946ceff None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.227465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494486da-41f1-478d-8945-8357b946ceff None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.233311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 49/100] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:53.234641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f81e3-7b44-4d9e-9495-8d6b8dbaf61b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.234928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f81e3-7b44-4d9e-9495-8d6b8dbaf61b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.235207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f81e3-7b44-4d9e-9495-8d6b8dbaf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.255916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-351f81e3-7b44-4d9e-9495-8d6b8dbaf61b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:53.257606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-351f81e3-7b44-4d9e-9495-8d6b8dbaf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:53.319938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:53.404198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 50/101] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:53.407080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a95e0-ffcb-4ae7-98de-7f34ed04e473 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.407377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a95e0-ffcb-4ae7-98de-7f34ed04e473 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.407664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a95e0-ffcb-4ae7-98de-7f34ed04e473 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.408958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 51/102] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:53.418746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.419036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.419325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.430275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a87d2-afce-4be4-8b78-3da5ecf1d6ef None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.454589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:53.457091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:53.507288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.508003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.508295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.509112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.525936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:53.531428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:53.548289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:53.549131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:06:53.549888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:53.552572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 52/103] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:53.559673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.620830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 52/104] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:53.714908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b91f-158e-4b0f-bc6d-cb8423acc99a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.730012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:53.757133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.758065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.758555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.759089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.759954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:53.760493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:53.765586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:53.774599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 53/105] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:53.781349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.906863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.909836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759ecc1-ae23-4f9c-a082-62f83c5b3918 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.961634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.963340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.963850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.964326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] PATH_INFO: `/v3/users/df3f54a45b174a398d797d98d5194c90` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.992458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] RBAC: Authorizing `identity:get_user(user_id=df3f54a45b174a398d797d98d5194c90)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:53.994490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:53.996756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 53/106] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/users/df3f54a45b174a398d797d98d5194c90 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:54.000743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.052908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7613f-6cf3-49fa-a2b5-902fd5e86476 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.065195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.085834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.086470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.087286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.087562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.109720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:54.117407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:54.118798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:54.120035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:54.122438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 54/107] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:54.122982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.199144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.235469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d0f4-2dd8-4571-9541-ba3865b812f1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.307420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.307984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.308265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.308539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.309697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.311140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.314348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 54/108] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:54.314921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.343506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e137-e7a8-4ce7-b1a3-c191f07f197a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.413296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b7d83-3e94-4707-9d7e-b2e3680952b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.413923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7d83-3e94-4707-9d7e-b2e3680952b1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.414208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7d83-3e94-4707-9d7e-b2e3680952b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.414487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7d83-3e94-4707-9d7e-b2e3680952b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.528834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.536835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ec81d-6e77-42ba-ad8d-6beb9f32946a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.537011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b7d83-3e94-4707-9d7e-b2e3680952b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.540833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b7d83-3e94-4707-9d7e-b2e3680952b1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.582417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.583143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.583523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.583809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.584480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:54.584787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.588962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.590213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.611375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 55/109] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:54.612233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.717112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 55/110] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:06:54.719249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c76ee-4acb-455e-b221-dc8b2ed76442 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.719782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c76ee-4acb-455e-b221-dc8b2ed76442 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.720274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c76ee-4acb-455e-b221-dc8b2ed76442 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.721859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 56/111] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:54.723119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c76ee-4acb-455e-b221-dc8b2ed76442 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.760132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f1d1-0d91-43fb-a691-25f85b82c5b4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.793818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230b8a8-ae5d-4c76-afba-ac94e23db85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.794433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b8a8-ae5d-4c76-afba-ac94e23db85d None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.794716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b8a8-ae5d-4c76-afba-ac94e23db85d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.794996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230b8a8-ae5d-4c76-afba-ac94e23db85d None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.795654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230b8a8-ae5d-4c76-afba-ac94e23db85d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.797166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230b8a8-ae5d-4c76-afba-ac94e23db85d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.825417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c76ee-4acb-455e-b221-dc8b2ed76442 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.859266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c88f2f-e73d-4a7c-a924-fe8735360136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.859905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c88f2f-e73d-4a7c-a924-fe8735360136 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.860194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c88f2f-e73d-4a7c-a924-fe8735360136 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.860478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c88f2f-e73d-4a7c-a924-fe8735360136 None admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.861636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c88f2f-e73d-4a7c-a924-fe8735360136 None admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.863107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c88f2f-e73d-4a7c-a924-fe8735360136 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.864692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 57/112] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:54 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:54.865875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c637-d927-49e9-8405-47ffe173a7bf None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.866167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c637-d927-49e9-8405-47ffe173a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.866446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c637-d927-49e9-8405-47ffe173a7bf None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.867656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 58/113] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:54.872575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2ca4-9f1a-4cb6-a006-47569edc2285 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.872893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2ca4-9f1a-4cb6-a006-47569edc2285 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.873177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2ca4-9f1a-4cb6-a006-47569edc2285 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.874389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 59/114] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:54.875098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2ca4-9f1a-4cb6-a006-47569edc2285 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.877736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.898501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 56/115] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:06:54 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:54.900241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.900526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.900826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.920559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:54.921855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:54.924560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.999834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2ca4-9f1a-4cb6-a006-47569edc2285 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.009238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 57/116] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:55.009238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.050248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014975-b95e-4314-aca5-ef864ac44d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.051053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014975-b95e-4314-aca5-ef864ac44d9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.051333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014975-b95e-4314-aca5-ef864ac44d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.051630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014975-b95e-4314-aca5-ef864ac44d9b None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.052797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014975-b95e-4314-aca5-ef864ac44d9b None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:55.054317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014975-b95e-4314-aca5-ef864ac44d9b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:55.056302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 60/117] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:54 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:55.057357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19845d5f-1c3e-4a4d-b84d-6339850834e1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.057651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19845d5f-1c3e-4a4d-b84d-6339850834e1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.057998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19845d5f-1c3e-4a4d-b84d-6339850834e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.077747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-19845d5f-1c3e-4a4d-b84d-6339850834e1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:55.080006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-19845d5f-1c3e-4a4d-b84d-6339850834e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:55.129264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d495bc-d585-4bae-9e7a-594ad9cf4eb2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.164514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:55.171030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 61/118] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:55.171805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.172325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.172621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.176932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.177470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.177977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.178501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.181551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:55.183207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:55.185036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 58/119] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:55.185815 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.236950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:55.238182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:55.242855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:55.344438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 62/120] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:55.345834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.363912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33e7ce-308f-46b5-962a-0fbb132297c4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.409332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.410114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.410717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.411007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.412020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] RBAC: Adding query filter params (role.id=601c474f2bf14167a1b78810e368b2af, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=df3f54a45b174a398d797d98d5194c90) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:55.412341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:55.413994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:55.421588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 59/121] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/role_assignments?user.id=df3f54a45b174a398d797d98d5194c90&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=601c474f2bf14167a1b78810e368b2af => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:55.422408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.489935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7283b-ce04-488d-b999-5eb4990e45f5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.529356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:55.536053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.537219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.537730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.538260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807/users/2bdffc3106dc45bebf612cd563b7955e/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.552968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ee288e46e40168538694a0221a807, user_id=2bdffc3106dc45bebf612cd563b7955e, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:55.552968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:55.554137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:55.591533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e710d2-069d-46bc-8601-5dfd2374a72d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.627763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.628329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.628611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.628914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.640009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:55.645583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:55.652260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 60/122] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:55.653076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.692920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 63/123] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:55 2022] PUT /identity/v3/projects/5b9ee288e46e40168538694a0221a807/users/2bdffc3106dc45bebf612cd563b7955e/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:55.693669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.757948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98e27-5249-4dac-9b43-6fdb1f18a6f5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.796939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.797747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.797943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.798225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.805205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:55.822737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:55.831471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:55.832388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:06:55.833666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:55.840050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 61/124] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:55.843501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.895364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d7fc-2a25-4520-990f-d79ef232d39d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:55.934947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:55.935659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.935924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.936221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.936980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:55.937293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:55.938705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:55.948754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 64/125] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:55.949567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:55.978835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c914080-ea41-499a-9e4d-35286f7c4d70 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.012410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:56.016283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.017534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.018179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.018854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.033821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:56.039671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:56.041134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:06:56.041983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:06:56.044305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 62/126] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:56.045481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.071985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21502e-97a5-40b0-98ff-95b860258f0e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.103592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:56.110331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.110971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.111292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.111583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.112345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:56.112718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.114311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.124545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 65/127] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.125522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.243469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789479e1-2b02-4c6a-82ab-e91560895004 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.265184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ba3bb-c979-43ab-8923-f5ed561aa505 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.284299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:56.309877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.310510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.310798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.311076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.311762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:56.312070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.313662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.331062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.331267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 66/128] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.332053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.332177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.332350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.332623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.338112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.340201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.344445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 63/129] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.353490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.550144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d17024-aa3c-4701-9bce-8271f64aae7a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.561382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835040e9-ae7b-4c17-8783-303f679ef327 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:56.623846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.624821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.625313 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.625756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.629341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.632071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.636060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 64/130] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.644548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.645581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.646342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.646639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.646914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.649638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.651132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.653166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 67/131] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.653965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.768988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:56.780363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4dd86-b2a7-442f-8242-81663ed2819f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.820375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.821650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.821863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.822207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.830152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.831724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.838482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 65/132] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.839216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.904357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ad618-fbbe-45d7-936b-51c24f344627 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:56.946816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:56.947474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:56.947761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:56.948044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:56.949508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:56.951265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:56.953259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 68/133] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:56.955064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:56.986830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:57.079421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179586-e382-465f-8aed-cbe69044e05d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:57.094820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:57.125224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b63309-debe-4475-abca-e7c9fda2ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:57.126225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b63309-debe-4475-abca-e7c9fda2ed12 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.127058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b63309-debe-4475-abca-e7c9fda2ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.128058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b63309-debe-4475-abca-e7c9fda2ed12 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807/users/3f8b36c77511497eb74133de174cd566/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.130161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b63309-debe-4475-abca-e7c9fda2ed12 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ee288e46e40168538694a0221a807, user_id=3f8b36c77511497eb74133de174cd566, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:57.130624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96546aa9-191c-4c14-a143-c2d92c30ccff None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:57.131648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b63309-debe-4475-abca-e7c9fda2ed12 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:57.184520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:57.185486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.185942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.186375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] PATH_INFO: `/v3/projects/53f56d5320634f8bab3932d0ccb42d2a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.188054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] RBAC: Authorizing `identity:get_project(project_id=53f56d5320634f8bab3932d0ccb42d2a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:57.190410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:57.196987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 66/134] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:56 2022] GET /identity/v3/projects/53f56d5320634f8bab3932d0ccb42d2a => generated 312 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:57.196987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:57.230158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 69/135] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:56 2022] PUT /identity/v3/projects/5b9ee288e46e40168538694a0221a807/users/3f8b36c77511497eb74133de174cd566/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:57.232742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87a3c-e334-460a-a5d3-c11c2745c681 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.233802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87a3c-e334-460a-a5d3-c11c2745c681 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.234401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87a3c-e334-460a-a5d3-c11c2745c681 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.236622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 70/136] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:57.238590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87a3c-e334-460a-a5d3-c11c2745c681 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:57.368147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87a3c-e334-460a-a5d3-c11c2745c681 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:57.409079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa18f8-a8ac-46fe-9de6-536be544ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:57.410196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa18f8-a8ac-46fe-9de6-536be544ccc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.410708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa18f8-a8ac-46fe-9de6-536be544ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.411195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa18f8-a8ac-46fe-9de6-536be544ccc0 None admin] PATH_INFO: `/v3/projects/53f56d5320634f8bab3932d0ccb42d2a/users/3f8b36c77511497eb74133de174cd566/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.413676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa18f8-a8ac-46fe-9de6-536be544ccc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=53f56d5320634f8bab3932d0ccb42d2a, user_id=3f8b36c77511497eb74133de174cd566, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:57.416014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa18f8-a8ac-46fe-9de6-536be544ccc0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:57.454821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27315d0-0804-444d-8734-f509c48f76c1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:57.481985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:57.496373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72508aa0-7983-4e53-9ff0-fab48af14135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:57.497552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72508aa0-7983-4e53-9ff0-fab48af14135 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.498132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72508aa0-7983-4e53-9ff0-fab48af14135 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.498746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72508aa0-7983-4e53-9ff0-fab48af14135 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807/users/3f8b36c77511497eb74133de174cd566/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.501421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72508aa0-7983-4e53-9ff0-fab48af14135 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ee288e46e40168538694a0221a807, user_id=3f8b36c77511497eb74133de174cd566, role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:57.510280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 71/137] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:57 2022] PUT /identity/v3/projects/53f56d5320634f8bab3932d0ccb42d2a/users/3f8b36c77511497eb74133de174cd566/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:57.512024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd349fc-9848-4f48-89cc-c4e16ed27bfe None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.512468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd349fc-9848-4f48-89cc-c4e16ed27bfe None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.517113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd349fc-9848-4f48-89cc-c4e16ed27bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.519792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72508aa0-7983-4e53-9ff0-fab48af14135 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:57.549575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9dd349fc-9848-4f48-89cc-c4e16ed27bfe None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:57.550475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9dd349fc-9848-4f48-89cc-c4e16ed27bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:57.590153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:57.607596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 67/138] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:57 2022] PUT /identity/v3/projects/5b9ee288e46e40168538694a0221a807/users/3f8b36c77511497eb74133de174cd566/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:57.656197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 72/139] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:57.930304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55a79-aa23-4032-a461-6ec23ea2d25e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.930825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55a79-aa23-4032-a461-6ec23ea2d25e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.930825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55a79-aa23-4032-a461-6ec23ea2d25e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.932337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 68/140] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:57.939537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:57.944946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:57.944946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:57.962318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:57.963533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:57.993743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55a79-aa23-4032-a461-6ec23ea2d25e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:58.102030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 73/141] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:06:58.161550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55a79-aa23-4032-a461-6ec23ea2d25e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:58.197634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c6c21-4989-4d8c-9b7d-a0a6e49e31ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:58.198204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c6c21-4989-4d8c-9b7d-a0a6e49e31ef None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:58.198488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c6c21-4989-4d8c-9b7d-a0a6e49e31ef None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:58.198764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c6c21-4989-4d8c-9b7d-a0a6e49e31ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:58.199928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c6c21-4989-4d8c-9b7d-a0a6e49e31ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:58.201524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c6c21-4989-4d8c-9b7d-a0a6e49e31ef None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:58.203460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 69/142] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:58.209270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:58.320649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:58.331646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec38675-d9a3-4aed-8d86-67377a1b9dae None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:58.385014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:58.385645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:58.385930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:58.386203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:58.386878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:58.388343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:58.409071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25f08-1b51-4c90-98df-b26fca17dff2 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:58.409376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25f08-1b51-4c90-98df-b26fca17dff2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:58.415536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25f08-1b51-4c90-98df-b26fca17dff2 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:58.415536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 70/143] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:58.417362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:58.417653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:58.417927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:58.444970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:58.446223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:58.517949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:58.541264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 74/144] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:06:58 2022] POST /identity/v3/users => generated 283 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:58.542659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:58.559309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 71/145] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:06:58.745937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38aede-65f0-4429-8218-293f9e8225d6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:58.791673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:58.792236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:58.792520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:58.792796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:58.810013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:58.815562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:58.816996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:58.817754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 75/146] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:58.826359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:58.992617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.003041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1a18-9ec8-4686-bc29-5880dccc005e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.012649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:59.068730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.069385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.069663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.069946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.070631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:59.071460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:59.072933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:59.092329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 72/147] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:06:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:59.098228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.161853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c58689-ed44-4459-a8e7-141c179c5754 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.206942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.207875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.208343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.208776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.216934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:59.225309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:59.232329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:59.233505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:59.234412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:06:59.236569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 76/148] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:59.244007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.331629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:59.372959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7fbfc-9dff-4acb-a938-aa1bdcdd8861 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.375592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580e3ec-422b-4419-b3d1-1eb7eee6c7bc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.415639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.416647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.417107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.417546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.418508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:59.418959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:59.420905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:59.432621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 77/149] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:59.439045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.481556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.482370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.482756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.483135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] PATH_INFO: `/v3/users/df3f54a45b174a398d797d98d5194c90` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.489683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] RBAC: Authorizing `identity:get_user(user_id=df3f54a45b174a398d797d98d5194c90)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:59.491158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:59.493539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 73/150] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:59 2022] GET /identity/v3/users/df3f54a45b174a398d797d98d5194c90 => generated 289 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:59.501817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.559689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a37e94-f6b8-4a5a-be3e-c2b850fef36e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.606115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.607042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.607478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.607894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] PATH_INFO: `/v3/users/2bdffc3106dc45bebf612cd563b7955e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.609248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] RBAC: Authorizing `identity:get_user(user_id=2bdffc3106dc45bebf612cd563b7955e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:59.611538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:59.614184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 78/151] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:59 2022] GET /identity/v3/users/2bdffc3106dc45bebf612cd563b7955e => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:59.614452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:59.620490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.731813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47600-22ec-44f9-8917-772fda7276f4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.750667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd50175-2cd1-4ff7-8d9e-a393656a41c8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:59.757462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:59.818339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.818976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.819314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.819574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.820789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:59.823318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:59.824975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 74/152] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:59 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:59.830983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:59.837345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:59.837969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:59.838246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:59.838517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:59.989257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:59.995551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:59.997131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:00.064498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe1cd-cae1-4868-ac8f-445627edfc8c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:00.127647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24064-0992-4e0a-882e-f9de365647c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:00.128336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24064-0992-4e0a-882e-f9de365647c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.128722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24064-0992-4e0a-882e-f9de365647c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.129033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24064-0992-4e0a-882e-f9de365647c8 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807/users/df3f54a45b174a398d797d98d5194c90/roles/601c474f2bf14167a1b78810e368b2af` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:00.132524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24064-0992-4e0a-882e-f9de365647c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ee288e46e40168538694a0221a807, user_id=df3f54a45b174a398d797d98d5194c90, role_id=601c474f2bf14167a1b78810e368b2af)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:00.136141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24064-0992-4e0a-882e-f9de365647c8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:00.139436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 79/153] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:00.145031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:00.240724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 75/154] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:59 2022] PUT /identity/v3/projects/5b9ee288e46e40168538694a0221a807/users/df3f54a45b174a398d797d98d5194c90/roles/601c474f2bf14167a1b78810e368b2af => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:00.259662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:00.263519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147cf5-8450-423a-bf22-a67e2c341eff None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:00.302743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:00.303411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.303706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.303968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:00.307639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:00.310542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:00.312882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 80/155] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:00 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:00.314754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80bf8-9386-411f-a188-7bad9c6f7b10 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.315051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80bf8-9386-411f-a188-7bad9c6f7b10 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.315336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80bf8-9386-411f-a188-7bad9c6f7b10 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:00.316717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 76/156] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:00.318756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:00.338691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716db-b17b-4d10-937c-68ed50064db6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.339008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716db-b17b-4d10-937c-68ed50064db6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.339256 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716db-b17b-4d10-937c-68ed50064db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:00.378673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e18716db-b17b-4d10-937c-68ed50064db6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:00.379952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e18716db-b17b-4d10-937c-68ed50064db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:00.447659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba698d81-a5e8-461b-9290-6aa988491ad0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:00.485544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:00.488474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:00.489371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.489789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.490199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:00.491172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=2bdffc3106dc45bebf612cd563b7955e) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:00.491667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:00.493461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7299-b323-4ffe-9620-8cfd047e6f90 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:00.502667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 81/157] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:00 2022] GET /identity/v3/role_assignments?user.id=2bdffc3106dc45bebf612cd563b7955e&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:00.579085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 77/158] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:00.971146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25372c21-4e7a-467d-8429-78363acaad1c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.971703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25372c21-4e7a-467d-8429-78363acaad1c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.972208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25372c21-4e7a-467d-8429-78363acaad1c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:00.973791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 82/159] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:00.979997 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:00.980296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:00.980574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.005176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:01.006386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:01.093669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 78/160] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:01.147734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25372c21-4e7a-467d-8429-78363acaad1c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:01.189236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:01.277189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25372c21-4e7a-467d-8429-78363acaad1c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:01.315198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f22da-8131-41f9-af49-d362cfb909d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:01.315838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f22da-8131-41f9-af49-d362cfb909d2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:01.316120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f22da-8131-41f9-af49-d362cfb909d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:01.316393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f22da-8131-41f9-af49-d362cfb909d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.329119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f22da-8131-41f9-af49-d362cfb909d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-dc9f22da-8131-41f9-af49-d362cfb909d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:01.334321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:01.335211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:01.335975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 83/161] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:01.341521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:01.431398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a4637-5645-4995-acde-7e921169a658 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:01.431742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a4637-5645-4995-acde-7e921169a658 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:01.432003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a4637-5645-4995-acde-7e921169a658 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.433403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 84/162] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:01.442393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:01.442686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:01.442966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.481213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:01.482441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:01.489577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:01.499121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cc8e7-e831-433d-87be-46641a58c5fb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:01.577980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:01.578602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:01.578890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:01.579162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.580104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:01.581470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:01.582890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:01.603683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 79/163] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:01.610512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:01.636855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 85/164] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:01.734167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:01.770292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:01.792561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077d606-fd0e-4b63-b9a1-6604f5b357f8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:01.885225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc506-b03e-4d90-b629-5e931fc14538 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:01.890069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:01.890736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:01.891017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:01.891284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.892453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:01.893947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:01.895843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 80/165] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:01 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:01.902027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:01.921708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:01.922354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:01.922637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:01.922915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:01.933828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:01.939061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:01.939906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:01.940972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 86/166] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:01.946897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:01.957196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:02.041281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:02.054094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ccf48-dbeb-4dc9-b457-2165c335c6ef None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.070395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a3d5-30e1-492d-8b8f-9ee1e5e5428c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.092207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.092993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.093368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.093718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.094594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:02.095183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:02.096844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:02.106423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 87/167] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:02.112223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:02.127873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.128484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.128767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.129071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.224146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68bf32-bada-4059-b611-821d10f9a9a9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.243421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:02.244926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:02.260911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.261657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.262017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.262407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.263683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:02.265371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:02.267252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 88/168] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:02 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:02.268176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:02.309198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:02.313193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:02.406477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 81/169] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:02.412316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26b67-98ca-4140-90cc-1b7cd1835c37 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.413787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:02.492320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.493440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.493722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.493992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.515460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:02.530165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:02.531102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:02.531967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:02.534467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 89/170] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:02.535565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:02.634425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba6a4e-55a6-490f-afd1-5edcb937d189 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.665287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:02.685606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ea8f9-790b-4d82-97c4-e8c0f99b82c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.686224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ea8f9-790b-4d82-97c4-e8c0f99b82c2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.686507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ea8f9-790b-4d82-97c4-e8c0f99b82c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.686779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ea8f9-790b-4d82-97c4-e8c0f99b82c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.693158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:02.748017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1524bcf-dba6-4b27-a6f1-109eeef81b44 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.788180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.789000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.789289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.789568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.790823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:02.792365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:02.798825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 90/171] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:02 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:02.799818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:02.847236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ea8f9-790b-4d82-97c4-e8c0f99b82c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:02.848736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ea8f9-790b-4d82-97c4-e8c0f99b82c2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:02.951355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68dbcc-89db-461f-a4ca-67b13666a3b6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:02.989961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:02.990696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:02.990983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:02.991263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:02.991935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:02.992245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:02.993901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa369c8-d2d2-42b3-a581-8e555f96ddd3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:02.998413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 82/172] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:03.000386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:03.001770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e791-a7e9-4bfa-9cc8-9e885bf97d8b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.002314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e791-a7e9-4bfa-9cc8-9e885bf97d8b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.002760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e791-a7e9-4bfa-9cc8-9e885bf97d8b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.004509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 83/173] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:03.005452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14e791-a7e9-4bfa-9cc8-9e885bf97d8b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:03.015117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 91/174] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:03.017145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a04c-fc0c-4b3f-b98d-142ac5ad598d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.017507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a04c-fc0c-4b3f-b98d-142ac5ad598d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.017854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a04c-fc0c-4b3f-b98d-142ac5ad598d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.019547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 92/175] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:03.024663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a04c-fc0c-4b3f-b98d-142ac5ad598d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:03.046135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:03.138257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14e791-a7e9-4bfa-9cc8-9e885bf97d8b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:03.168380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a04c-fc0c-4b3f-b98d-142ac5ad598d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:03.185707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:03.186664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.187260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.187679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.188988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=3f8b36c77511497eb74133de174cd566) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:03.189462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:03.191268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4605de-d871-4488-84ce-0db53a22448a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:03.200672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 84/176] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:03 2022] GET /identity/v3/role_assignments?user.id=3f8b36c77511497eb74133de174cd566&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:03.202910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951cfc-a7fa-411d-b97d-4e523256df39 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.203517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951cfc-a7fa-411d-b97d-4e523256df39 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.203994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951cfc-a7fa-411d-b97d-4e523256df39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.207107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:03.208100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.208485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.208940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] PATH_INFO: `/v3/projects/53f56d5320634f8bab3932d0ccb42d2a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.210422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] RBAC: Authorizing `identity:get_project(project_id=53f56d5320634f8bab3932d0ccb42d2a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:03.212685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:03.215112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 93/177] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:03 2022] GET /identity/v3/projects/53f56d5320634f8bab3932d0ccb42d2a => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:03.220482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:03.230938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b1951cfc-a7fa-411d-b97d-4e523256df39 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:03.232331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b1951cfc-a7fa-411d-b97d-4e523256df39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:03.310579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:03.357006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70fdb5-90c2-4893-b014-7cb8e534d772 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:03.368591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 85/178] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:03.372935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.372935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.372935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.406232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:03.407455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:03.423219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:03.423931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.424215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.424491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] PATH_INFO: `/v3/users/3f8b36c77511497eb74133de174cd566` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.427826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8b36c77511497eb74133de174cd566)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:03.429465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:03.432966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 94/179] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:03 2022] GET /identity/v3/users/3f8b36c77511497eb74133de174cd566 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:03.439279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:03.449824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:03.551822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 86/180] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:03.552427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:03.639732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640abbc-d7db-4398-b194-f7eed4d478a7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:03.687458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:03.688123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.688410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.688690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.689483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=53f56d5320634f8bab3932d0ccb42d2a, user.id=3f8b36c77511497eb74133de174cd566) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:03.689965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:03.691451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33878b72-a8c7-4ea9-bfd5-14d47ace6ea2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:03.699979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 95/181] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:03 2022] GET /identity/v3/role_assignments?user.id=3f8b36c77511497eb74133de174cd566&scope.project.id=53f56d5320634f8bab3932d0ccb42d2a&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:03.701236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:03.733387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13fc4-0a9c-4073-af89-8bc29611e94f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.733702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13fc4-0a9c-4073-af89-8bc29611e94f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.734576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13fc4-0a9c-4073-af89-8bc29611e94f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.737181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 96/182] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:03.744953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b489-af95-4b63-a4a8-587e12e1ddaf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.745411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b489-af95-4b63-a4a8-587e12e1ddaf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.745698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b489-af95-4b63-a4a8-587e12e1ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.786987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-08f2b489-af95-4b63-a4a8-587e12e1ddaf None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:03.788263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-08f2b489-af95-4b63-a4a8-587e12e1ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:03.791469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c077d-577d-4f34-9fca-3b5b466d7245 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:03.856375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:03.857032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.857320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.857598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.884608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:03.902352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 97/183] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:03.902352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26833d-8a74-4bf6-a690-a7907819a613 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.902788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26833d-8a74-4bf6-a690-a7907819a613 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.903090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26833d-8a74-4bf6-a690-a7907819a613 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.904955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 98/184] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:03.905802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26833d-8a74-4bf6-a690-a7907819a613 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:03.948053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:03.950517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.043847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26833d-8a74-4bf6-a690-a7907819a613 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.074967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.080983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701906-56e6-4c4d-aafb-cfa3a7ba9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.081628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701906-56e6-4c4d-aafb-cfa3a7ba9d9a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.081951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701906-56e6-4c4d-aafb-cfa3a7ba9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.082284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701906-56e6-4c4d-aafb-cfa3a7ba9d9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.088258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 87/185] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:04.089930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.093190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5701906-56e6-4c4d-aafb-cfa3a7ba9d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c5701906-56e6-4c4d-aafb-cfa3a7ba9d9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:04.098670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:04.099532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:04.100388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 99/186] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:04.102607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.102607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.102607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.131215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:04.133984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:04.153691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.204207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f33e9-1c2f-4185-9178-ac12bd967496 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.214686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 100/187] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:04.215546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.241992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.243253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.243550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.243827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.254538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:04.259541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:04.260442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:04.261260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 88/188] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:04.261933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.331644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db436ae-b6d3-41c7-a291-7cbbd040f7ce None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.351765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.366682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.367332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.368239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.368550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.369770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.371317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.373005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 101/189] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.373769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.386843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3d99-d29f-4123-b5e3-15bb347ce381 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.402114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.424099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.424653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.424957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.425272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.425903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:04.426208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.427607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.445307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 89/190] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.445307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.480029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc538b6-799e-49ff-bf6d-1afd66d87c52 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.520707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.521381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.521668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.521954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.533514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:04.539110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:04.540689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:04.541502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 102/191] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:04.542519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.573194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c2c8-80c0-4c56-a338-c5e50dc1e0f5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.596457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.608116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.611949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.611949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.611949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.611949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:04.611949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.611949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.621330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 90/192] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.625699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.663905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f7f2-3301-4ff3-b85f-ef590acf971f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.668699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.698452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.698982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.699266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.699545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.700284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] RBAC: Adding query filter params (role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=3f8b36c77511497eb74133de174cd566) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:04.700598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.702114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.709990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 103/193] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/role_assignments?user.id=3f8b36c77511497eb74133de174cd566&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.712453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.755462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0662885-a6ac-49af-b3e6-6bb3402ed39c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.793773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.794423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.794706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.794985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] PATH_INFO: `/v3/users/38dee11c0853430889ef292bc6125d1f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.811951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] RBAC: Authorizing `identity:get_user(user_id=38dee11c0853430889ef292bc6125d1f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.813529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.815475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 91/194] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/users/38dee11c0853430889ef292bc6125d1f => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.816263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.837240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16651e4e-5f29-4d78-81b9-48cea45d09b6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.854992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.878843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.879789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.880074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.880349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.881516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.884020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.885762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 104/195] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.886597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.934095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.941185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631b38-c7e8-4797-bdcc-2c48217981cb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.977685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.978228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.978508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.978792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.979438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:04.979739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.981159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.989282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 92/196] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.989866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.995174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98282-b1b6-4554-b1fb-af06a6c24400 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.032238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.032911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.033198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.033477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] PATH_INFO: `/v3/users/38dee11c0853430889ef292bc6125d1f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.034630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] RBAC: Authorizing `identity:get_user(user_id=38dee11c0853430889ef292bc6125d1f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.036132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.037794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 105/197] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/users/38dee11c0853430889ef292bc6125d1f => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:05.038614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.088362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:05.097672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9d57-93a6-4be8-aef0-ced34c246fdd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.132990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.133626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.133912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.134188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.141124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262159ce-d63a-44ef-b9b0-f82522741e03 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.172954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:05.176925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.177547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.177826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.178100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.178763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.180287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.219720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.221401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.292338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 106/198] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:05 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:05.293153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.331505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 93/199] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:05.332310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.424670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:05.434708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ca139-fdd8-412a-884a-7d3132cc8b78 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.438200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:05.493076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.494090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.494439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.494894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] PATH_INFO: `/v3/users/df3f54a45b174a398d797d98d5194c90` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.497185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] RBAC: Authorizing `identity:get_user(user_id=df3f54a45b174a398d797d98d5194c90)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.500178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.504566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 107/200] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:05 2022] GET /identity/v3/users/df3f54a45b174a398d797d98d5194c90 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:05.506462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.508999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9389f-e61f-4ed0-a9f2-d0a6b23566a2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.562273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.563523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.563523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.563523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.656116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015a39-15b3-4568-ac48-38b89051fe4e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.666980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.668585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.705807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.706454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.706736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.707010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.708285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.709991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.712150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 108/201] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:05 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:05.717179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.738652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:05.767585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:05.790949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 94/202] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:05.791986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.836381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda59d26-ee7b-4e11-bca9-1e7260e16741 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.877087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.877708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.877983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.878255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.913508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29fab1-594c-4626-a2ce-18d9b86731f0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:05.953544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:05.954174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:05.954723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:05.954927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.955060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:05.955806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=38dee11c0853430889ef292bc6125d1f) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:05.956117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:05.956492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.957763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:05.964396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 95/203] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:05 2022] GET /identity/v3/role_assignments?user.id=38dee11c0853430889ef292bc6125d1f&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:05.965434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:05.993962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:06.089340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:06.179947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d9415-1c87-4081-b1e8-494337bdc359 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:06.216218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 109/204] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:06.226403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:06.241674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:06.243083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.243406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.243682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.245609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:06.249087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:06.250860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 96/205] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:05 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:06.256863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:06.386358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0999a-2839-4fd3-8333-d8782f82026d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:06.429340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:06.430054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.430381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.430663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.431886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:06.433419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:06.440869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 110/206] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:06 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:06.442998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:06.457045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:06.462532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:06.489686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c1737-1b13-4613-9e53-2d77807e4dad None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:06.585790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:06.586987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.588563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.588870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.589635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] RBAC: Adding query filter params (role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=38dee11c0853430889ef292bc6125d1f) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:06.589952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:06.592274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a86de1-fbda-4abd-962d-8573c331234c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:06.597037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e33-1cdf-46c1-bf96-a3ee171e3d05 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:06.608886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 97/207] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:06 2022] GET /identity/v3/role_assignments?user.id=38dee11c0853430889ef292bc6125d1f&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:06.651733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:06.652281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.652567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.652870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.653635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] RBAC: Adding query filter params (role.id=601c474f2bf14167a1b78810e368b2af, scope.project.id=5b9ee288e46e40168538694a0221a807, user.id=df3f54a45b174a398d797d98d5194c90) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:06.653950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:06.655425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc1d2-0c3b-4e9c-a9cf-d70696836ccb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:06.666661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 111/208] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:06 2022] GET /identity/v3/role_assignments?user.id=df3f54a45b174a398d797d98d5194c90&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=601c474f2bf14167a1b78810e368b2af => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:07.621580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd314d9-71dd-4aa8-ac5e-79856b4fcbb6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:07.622121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd314d9-71dd-4aa8-ac5e-79856b4fcbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:07.622121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd314d9-71dd-4aa8-ac5e-79856b4fcbb6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:07.623498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 98/209] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:07.628744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:07.629168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:07.629336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:07.647615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:07.649383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:07.660514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df567df-e570-43e9-ba45-50d2971fef1c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:07.661122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df567df-e570-43e9-ba45-50d2971fef1c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:07.661608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df567df-e570-43e9-ba45-50d2971fef1c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:07.663158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 99/210] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:07.668625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:07.669213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:07.669711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:07.688918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:07.690444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:07.734794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 112/211] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:07.775384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 100/212] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:08.012850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.015411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:08.065314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.124236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b1d5e-0be2-42c3-a651-116ad8dd4a46 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.160950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:08.161827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6287e1a-d9ee-4c61-9c75-00dd6647a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.162669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6287e1a-d9ee-4c61-9c75-00dd6647a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.163057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6287e1a-d9ee-4c61-9c75-00dd6647a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.163335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6287e1a-d9ee-4c61-9c75-00dd6647a4f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.165024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6287e1a-d9ee-4c61-9c75-00dd6647a4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:08.166506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6287e1a-d9ee-4c61-9c75-00dd6647a4f5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:08.168145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 113/213] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:08.169345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9e26-181a-40a7-a56b-8fa1fd299967 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.169608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9e26-181a-40a7-a56b-8fa1fd299967 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.170081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9e26-181a-40a7-a56b-8fa1fd299967 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.175572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 114/214] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:08.175572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9e26-181a-40a7-a56b-8fa1fd299967 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.186809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8088b3-c637-4e46-bbee-a30850728f48 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.225128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b2d37-ec53-44e9-9698-524300c333f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.225689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b2d37-ec53-44e9-9698-524300c333f6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.225970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b2d37-ec53-44e9-9698-524300c333f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.226253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b2d37-ec53-44e9-9698-524300c333f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.238351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b2d37-ec53-44e9-9698-524300c333f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9a6b2d37-ec53-44e9-9698-524300c333f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:08.246167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:08.247209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:08.248106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:08.250366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 101/215] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:08.251749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.252043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.252323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.253261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:08.271307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:08.272481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:08.288765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9e26-181a-40a7-a56b-8fa1fd299967 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.328611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.329741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.330188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.330612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.331474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:08.333134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:08.360181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 102/216] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:08.360181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.434208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:08.465047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ab38a-3116-4fc4-bee4-0ee66a27f669 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.493244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 115/217] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:08 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:07:08.510235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.511220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.511695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.512156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.513074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:08.513615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:08.515324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:08.532030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 103/218] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:08.533498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.624224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.678314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f7cf-e32a-43ad-9e15-976c749ef0ba None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.711673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:08.723411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.724078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.724424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.724714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] PATH_INFO: `/v3/users/65350f4c216d4221b302eac70a94b962` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.750601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=65350f4c216d4221b302eac70a94b962)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:08.752424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:08.754460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 116/219] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/users/65350f4c216d4221b302eac70a94b962 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:08.760239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.779918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc950c-90fc-4d58-8ca5-a411a84f6270 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.827910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81a48-4bb9-484f-890f-22dfa0f09004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.828570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81a48-4bb9-484f-890f-22dfa0f09004 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.828940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81a48-4bb9-484f-890f-22dfa0f09004 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.829483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81a48-4bb9-484f-890f-22dfa0f09004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.831761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:08.845199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f81a48-4bb9-484f-890f-22dfa0f09004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-91f81a48-4bb9-484f-890f-22dfa0f09004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:08.850054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:08.856581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 104/220] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:08.857449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2050d-5517-4e40-bdc1-8e7d2a996733 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.858567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2050d-5517-4e40-bdc1-8e7d2a996733 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.858567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2050d-5517-4e40-bdc1-8e7d2a996733 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.858567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 105/221] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:08.860173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2050d-5517-4e40-bdc1-8e7d2a996733 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:08.904230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69075f-7941-4944-a896-996f6cab0ea2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:08.947249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:08.949852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.950522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.950951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.997659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2050d-5517-4e40-bdc1-8e7d2a996733 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.024413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.034006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.042363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.042363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.042363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.042363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:09.042363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.042363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415231-267d-45a6-b65d-8a23e4e29e1f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.044828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.046734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.047968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 106/222] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:09.049483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.049768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.050040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.071133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:09.072506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:09.143521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.168966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 107/223] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:09.174091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 117/224] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:09.174221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.175885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.276819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.295471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a6828-2c6d-4ddf-a4d3-220b1995ee9b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.302316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453feaa8-3321-493a-ae6c-96d3b5d9dc5e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.345239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.346602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.347040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.347741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] PATH_INFO: `/v3/users/38dee11c0853430889ef292bc6125d1f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.349669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] RBAC: Authorizing `identity:get_user(user_id=38dee11c0853430889ef292bc6125d1f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.352348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.355014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.355252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 108/225] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/users/38dee11c0853430889ef292bc6125d1f => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:09.355752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.356179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.356527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.361355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.362223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.363863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.368566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 118/226] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:09.375648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.467516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.526069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8079b4-386e-4f70-9187-d790eb566bdf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.559989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6635-378b-4cdd-b9d6-6b9cf2bb4692 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.567130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.567961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.568314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.568661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.571147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.573500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.575741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 109/227] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:09.576585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.596853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.597421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.597701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.597973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.598697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=65350f4c216d4221b302eac70a94b962) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:09.599000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.600689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.607045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 119/228] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/role_assignments?user.id=65350f4c216d4221b302eac70a94b962&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:09.615101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.661664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.765310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2145-4cef-4102-9f32-8020d01117b5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.822909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d0b4-6cca-44db-a8a8-fbf2d436b81b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.832107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.865647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.866131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.866330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.866589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.866867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.866965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.868104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.868403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66/users/38dee11c0853430889ef292bc6125d1f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.875548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb857b819d5248abbc3caefd80918b66, user_id=38dee11c0853430889ef292bc6125d1f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.877041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.892611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:09.898288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:09.906530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:09.907730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 110/229] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:09.909406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 120/230] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:09 2022] PUT /identity/v3/projects/bb857b819d5248abbc3caefd80918b66/users/38dee11c0853430889ef292bc6125d1f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:10.072741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb8c9-674c-4444-abb1-818b459c52f6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:10.115618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:10.116237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.116515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.116785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.123450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:10.123450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:10.123450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:10.129722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 111/231] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:10.137985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:10.233847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:10.258691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210dd4-bed1-4c83-bac6-f01c8a970619 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:10.303796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:10.304436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.304717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.305156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] PATH_INFO: `/v3/users/38dee11c0853430889ef292bc6125d1f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.306294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] RBAC: Authorizing `identity:get_user(user_id=38dee11c0853430889ef292bc6125d1f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:10.307743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:10.309747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 121/232] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:10 2022] GET /identity/v3/users/38dee11c0853430889ef292bc6125d1f => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:10.322736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:10.387287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:10.464886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbe80-0d6d-47ed-a81e-29e8ab45f8f7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:10.513816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054e71b-a88c-4ad2-b071-372d9a5739f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:10.514471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e71b-a88c-4ad2-b071-372d9a5739f0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.514758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e71b-a88c-4ad2-b071-372d9a5739f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.515038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e71b-a88c-4ad2-b071-372d9a5739f0 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.516203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054e71b-a88c-4ad2-b071-372d9a5739f0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:10.517712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054e71b-a88c-4ad2-b071-372d9a5739f0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:10.519388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 112/233] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:10 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:10.528189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:10.654380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b3a47-4633-4892-8cb0-2a128d4df377 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:10.692470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369b60e-2535-4584-b430-c307583eb30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:10.693170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b60e-2535-4584-b430-c307583eb30a None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.693457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b60e-2535-4584-b430-c307583eb30a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.693736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b60e-2535-4584-b430-c307583eb30a None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66/users/38dee11c0853430889ef292bc6125d1f/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.696104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369b60e-2535-4584-b430-c307583eb30a None admin] RBAC: Authorizing `identity:create_grant(project_id=bb857b819d5248abbc3caefd80918b66, user_id=38dee11c0853430889ef292bc6125d1f, role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:10.697602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369b60e-2535-4584-b430-c307583eb30a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:10.841502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 122/234] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:10 2022] PUT /identity/v3/projects/bb857b819d5248abbc3caefd80918b66/users/38dee11c0853430889ef292bc6125d1f/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:10.959640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7b79-08ba-423c-bc49-5c44d5d6af50 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.960303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7b79-08ba-423c-bc49-5c44d5d6af50 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.960303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7b79-08ba-423c-bc49-5c44d5d6af50 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.961540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 113/235] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:10.967404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.967851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.968254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.976035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:10.988504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:10.989850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:11.050513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec3eb3-a63a-4783-abff-580aa0bcb1ea None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:11.050792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec3eb3-a63a-4783-abff-580aa0bcb1ea None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:11.051059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec3eb3-a63a-4783-abff-580aa0bcb1ea None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:11.052598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 114/236] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:11.059251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:11.059538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:11.059816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:11.075425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 123/237] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:11.082359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:11.083708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:11.180111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 115/238] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:11.372738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:11.503365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592c34-0a90-4a04-8959-0a928b51ac86 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:11.541832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:11.552326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:11.553023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:11.553310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:11.553588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:11.560091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:11.566731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:11.571916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:11.576033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:11.576844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 124/239] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:11.578922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:11.639259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:11.756192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623811-43d7-461e-b91d-4545186bb204 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:11.769229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026820c-bdd2-4188-aa7e-bb307f77d0ee None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:11.823352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:11.823352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:11.823352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:11.823352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:11.824491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:11.832379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:11.832379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 116/240] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:11.833667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:11.848882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:11.850094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:11.850516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:11.850962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:11.851805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:11.852252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:11.853966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:11.863570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 125/241] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:11.869824 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:11.930756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:11.982040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8ebb-6765-4e8d-8f8e-0287d6644e4d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:11.983840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59284ed1-bdbd-4418-be8b-2df9a21b0971 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:11.995538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.017724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a507c1-d8ad-4046-9437-2ed4faa150f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.018635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a507c1-d8ad-4046-9437-2ed4faa150f8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.019058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a507c1-d8ad-4046-9437-2ed4faa150f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.019472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a507c1-d8ad-4046-9437-2ed4faa150f8 None admin] PATH_INFO: `/v3/users/3878e9a9a6dd4465a3b24b0920d45de1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.019661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69d586-33b1-4fdc-865c-828533e2f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.020266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d586-33b1-4fdc-865c-828533e2f56c None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.020552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d586-33b1-4fdc-865c-828533e2f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.020886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d586-33b1-4fdc-865c-828533e2f56c None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.021580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69d586-33b1-4fdc-865c-828533e2f56c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:12.023018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69d586-33b1-4fdc-865c-828533e2f56c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:12.035446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a507c1-d8ad-4046-9437-2ed4faa150f8 None admin] RBAC: Authorizing `identity:get_user(user_id=3878e9a9a6dd4465a3b24b0920d45de1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:12.037196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a507c1-d8ad-4046-9437-2ed4faa150f8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:12.038858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 126/242] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:11 2022] GET /identity/v3/users/3878e9a9a6dd4465a3b24b0920d45de1 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:12.040290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2be1-b5d8-4e66-9ec9-cf0f11a30d87 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.040573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2be1-b5d8-4e66-9ec9-cf0f11a30d87 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.040865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2be1-b5d8-4e66-9ec9-cf0f11a30d87 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.042056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 127/243] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:12.044518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2be1-b5d8-4e66-9ec9-cf0f11a30d87 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:12.113566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 117/244] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:11 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:12.115358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.115893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.116389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.136537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:12.138121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:12.165684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2be1-b5d8-4e66-9ec9-cf0f11a30d87 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:12.185453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.213853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.214478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.214758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.215035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.216623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 118/245] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:12.286514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:12.287992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:12.391988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 128/246] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:12.399100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:12.517631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.524274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60cc45-971f-4f8b-8e8a-05af151c4df7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:12.555393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:12.580082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.580885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.581204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.581424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.581642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.585179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:12.586691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:12.588705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 119/247] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:12 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:12.594844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:12.689072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a579-e6bb-488a-b77e-965b74ff0fd6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:12.723113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ec09-a815-485b-aa3f-6f7f3cb5c4a3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:12.738604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661a081-0cd8-48f3-a7ba-00609258804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.739244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661a081-0cd8-48f3-a7ba-00609258804c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.739520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661a081-0cd8-48f3-a7ba-00609258804c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.739779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661a081-0cd8-48f3-a7ba-00609258804c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.755439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661a081-0cd8-48f3-a7ba-00609258804c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7661a081-0cd8-48f3-a7ba-00609258804c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:12.761871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:12.762781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:12.763586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:12.764187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 129/248] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:12.765462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e918c-9647-457b-b74a-b43dffea6a51 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.765823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e918c-9647-457b-b74a-b43dffea6a51 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.766110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e918c-9647-457b-b74a-b43dffea6a51 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.767404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 130/249] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:12.771778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e918c-9647-457b-b74a-b43dffea6a51 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:12.778164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.778833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.779116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.779389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.780220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] RBAC: Adding query filter params (role.id=601c474f2bf14167a1b78810e368b2af, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=3878e9a9a6dd4465a3b24b0920d45de1) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:12.780530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:12.782092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90088c1-3305-42da-b4c1-0b096df43d36 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:12.790013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 120/250] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:12 2022] GET /identity/v3/role_assignments?user.id=3878e9a9a6dd4465a3b24b0920d45de1&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=601c474f2bf14167a1b78810e368b2af => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:12.791215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.791498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.791771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.814408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:12.815631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:12.846059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.876845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.899952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 121/251] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:12.903121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e918c-9647-457b-b74a-b43dffea6a51 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:12.942531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:12.943168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.943449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.943723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.944523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:12.944908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:12.947038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:12.958731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 131/252] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:12.964540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.112431 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaff5e9-10ee-4f58-80ca-29a1d85e33c6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.161664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.162309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.162591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.162865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] PATH_INFO: `/v3/users/65350f4c216d4221b302eac70a94b962` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.169562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] RBAC: Authorizing `identity:get_user(user_id=65350f4c216d4221b302eac70a94b962)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.171239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.174188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 122/253] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:12 2022] GET /identity/v3/users/65350f4c216d4221b302eac70a94b962 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:13.180760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.292390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.327421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339f888-5777-46aa-821d-47c4a086e360 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.345232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.396878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.397441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.397727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.398007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.405783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.407131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.409251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 132/254] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:13.415163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.424503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.441111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d0ab7-b105-451f-aea3-01f3d6e753b7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.497335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.498343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.498841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.499321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.520483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:13.529286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:13.530804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:13.532087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:13.542084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 123/255] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:13.550010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.593149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f422b-1356-4f71-8da7-34bf540690fa None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.631077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.631763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.632047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.632325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66/users/65350f4c216d4221b302eac70a94b962/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.634719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb857b819d5248abbc3caefd80918b66, user_id=65350f4c216d4221b302eac70a94b962, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.637757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.756044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 133/256] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:13 2022] PUT /identity/v3/projects/bb857b819d5248abbc3caefd80918b66/users/65350f4c216d4221b302eac70a94b962/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:13.756235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.796013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720293-0362-4023-92b8-462b76c5af40 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.871535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.872715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.873288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.873720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.874465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:13.874774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.876223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.886664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 124/257] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:13.892842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.986324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.042510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd1703-cc83-4550-a7ee-e15a87c76cb8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.093051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8867-7b9e-4ee7-ad04-1a18417b790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.093695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8867-7b9e-4ee7-ad04-1a18417b790d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.093976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8867-7b9e-4ee7-ad04-1a18417b790d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.094251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8867-7b9e-4ee7-ad04-1a18417b790d None admin] PATH_INFO: `/v3/users/38dee11c0853430889ef292bc6125d1f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.100932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8867-7b9e-4ee7-ad04-1a18417b790d None admin] RBAC: Authorizing `identity:get_user(user_id=38dee11c0853430889ef292bc6125d1f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.100932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8867-7b9e-4ee7-ad04-1a18417b790d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.102020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 134/258] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/users/38dee11c0853430889ef292bc6125d1f => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:14.107236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.230492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1c136-4ea5-4396-82c0-1e7ae9f7cd7f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.231166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1c136-4ea5-4396-82c0-1e7ae9f7cd7f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.231660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1c136-4ea5-4396-82c0-1e7ae9f7cd7f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.233400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 135/259] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:14.236843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c321b0-83ec-4f6c-a05c-24866d8d3547 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.243050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.243613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.244091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.280042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:14.281802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:14.291914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.292598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.292840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.293122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.326303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.365531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 136/260] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:14.416994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.418494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.562793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 125/261] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:14.568405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.659308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.688457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.706060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f82b5-9bdb-4eb4-8049-1c00cb6e1ea8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.767955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.771411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.772075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.772356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.772634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.777303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.778803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.782379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 137/262] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:14.786872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.848744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e30ac2-9731-4cb5-8aaf-cfa44e220a4b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.918269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.918906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.919180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.919451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.953113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:14.960098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:14.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:14.962338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 126/263] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:14.969340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:15.008509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c439547-f317-4577-85e6-e7f60459bdd5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:15.072041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:15.082474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:15.094603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.094603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.094603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.094603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=38dee11c0853430889ef292bc6125d1f) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:15.094603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:15.094603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:15.100667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 138/264] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/role_assignments?user.id=38dee11c0853430889ef292bc6125d1f&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:15.156846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0df6-b6ab-412d-95e5-b87786ce7419 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:15.175843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:15.210609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:15.211782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.212060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.212328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.213028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:15.213328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:15.214837 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:15.229584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 127/265] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:15.235214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:15.395217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b880-bfe9-444b-8d72-1fc97faeefe1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:15.439152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6ee0-2dd7-4b78-b558-6455db8095c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:15.440172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6ee0-2dd7-4b78-b558-6455db8095c1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.440658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6ee0-2dd7-4b78-b558-6455db8095c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.441276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6ee0-2dd7-4b78-b558-6455db8095c1 None admin] PATH_INFO: `/v3/users/38dee11c0853430889ef292bc6125d1f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.442627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6ee0-2dd7-4b78-b558-6455db8095c1 None admin] RBAC: Authorizing `identity:get_user(user_id=38dee11c0853430889ef292bc6125d1f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:15.444278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6ee0-2dd7-4b78-b558-6455db8095c1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:15.451284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 139/266] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:15 2022] GET /identity/v3/users/38dee11c0853430889ef292bc6125d1f => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:15.452545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:15.561769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccc7a-21a1-40d4-9fa8-18e2e48eeae3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.562379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccc7a-21a1-40d4-9fa8-18e2e48eeae3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.562884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccc7a-21a1-40d4-9fa8-18e2e48eeae3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.564659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 140/267] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:15.572126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccd2d3-1555-4868-94fb-1e0a23f914e6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.572864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccd2d3-1555-4868-94fb-1e0a23f914e6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.573350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccd2d3-1555-4868-94fb-1e0a23f914e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.601278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9cccd2d3-1555-4868-94fb-1e0a23f914e6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:15.603076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9cccd2d3-1555-4868-94fb-1e0a23f914e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:15.619255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22de88c-43a3-42cf-99de-1ff35d70fe9e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:15.681574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:15.682527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.683110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.683607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.737007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:15.746102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:15.768422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 141/268] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:15.773147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:15.776561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:15.798400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b223f13-994e-4208-838e-7c7ca3c0e061 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.798724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b223f13-994e-4208-838e-7c7ca3c0e061 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.798957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b223f13-994e-4208-838e-7c7ca3c0e061 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.801452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 142/269] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:15.805784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184b7f9-6b4c-41ca-8343-307ca1c54141 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.806076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184b7f9-6b4c-41ca-8343-307ca1c54141 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.806327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184b7f9-6b4c-41ca-8343-307ca1c54141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.850875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e184b7f9-6b4c-41ca-8343-307ca1c54141 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:15.853106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e184b7f9-6b4c-41ca-8343-307ca1c54141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:15.892238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 128/270] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:15.899089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:15.975281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.009206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b53d7-36e6-4c87-bc32-12aca7d4de98 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.041649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 143/271] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:16.055762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649336-4485-4fdc-bbf2-cc7929d9e9e6 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.056084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649336-4485-4fdc-bbf2-cc7929d9e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.056315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649336-4485-4fdc-bbf2-cc7929d9e9e6 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.057990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 144/272] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:16.063350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.063635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.063908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.068613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.069312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.069594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.069870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.072590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:16.074198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:16.078823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 129/273] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:15 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:16.085362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.093889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:16.095099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:16.167446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 145/274] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:16.168204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.202266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c330a-06f6-4fb6-a5f5-1af397ff323f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.232004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.245517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.246140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.246426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.246704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.247448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] RBAC: Adding query filter params (role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=38dee11c0853430889ef292bc6125d1f) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:16.248076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:16.250412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:16.266176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 130/275] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/role_assignments?user.id=38dee11c0853430889ef292bc6125d1f&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:16.314073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4f52d-5715-4a9a-ae73-56ec47a9bbde None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.324224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.327436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.367775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.368416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.368691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.368991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.382543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:16.392836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:16.393788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:16.394573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 146/276] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:16.396891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.508829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359617-801e-4884-af81-fcb51dcbc3c2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.525830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.528615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06861cd-dd4d-4dae-a8dc-470581cbe96b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.556913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.558297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.558297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.558297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.558812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:16.559115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:16.560858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:16.577372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.578106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.578378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.578563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.583700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 147/277] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:16.583700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.594256 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:16.599590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:16.600507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:16.601346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 131/278] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:16.602022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.683402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.715250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e108-3dd2-4a49-8330-4ea21bc49700 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.723042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b1a7-2526-45e1-9ac8-656f2c3fe14b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.751676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.752306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.752627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.752924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.753997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:16.755413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:16.757298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 148/279] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:16.758485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.764945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.765536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.765821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.766101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] PATH_INFO: `/v3/users/587bb2ec244a4d4bacbba75c89c3c6fd` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.781412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] RBAC: Authorizing `identity:get_user(user_id=587bb2ec244a4d4bacbba75c89c3c6fd)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:16.782886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:16.789482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 132/280] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/users/587bb2ec244a4d4bacbba75c89c3c6fd => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:16.789482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:16.809860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.869225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e1712-b34e-4547-857a-13c5c3e7a610 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.889123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3120b-2add-4be0-b67f-654348829039 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:16.906176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:16.906782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.907059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.907432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.908329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:16.908782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:16.910223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:16.910932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:16.921017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 149/281] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.008545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.008697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.008697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.008697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.008697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.009081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.009081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.022233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb99a-3f28-4fa4-9c81-82b67b403b31 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.025327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.055356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.056159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.056536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.056949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.057672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, user.id=587bb2ec244a4d4bacbba75c89c3c6fd, scope.system=all) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:17.057986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.059404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5056-90f1-4add-a2c2-cef806157c78 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.064175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 150/282] 10.222.0.76 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:16 2022] GET /identity/v3/role_assignments?user.id=587bb2ec244a4d4bacbba75c89c3c6fd&scope.system=all&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.065319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348f30-d384-4e65-bcc4-f1cdacb5d7e0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.065568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348f30-d384-4e65-bcc4-f1cdacb5d7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.065843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348f30-d384-4e65-bcc4-f1cdacb5d7e0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.067174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 151/283] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:17.067738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348f30-d384-4e65-bcc4-f1cdacb5d7e0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.177661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348f30-d384-4e65-bcc4-f1cdacb5d7e0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.216617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1825-39a5-4735-a884-6f0152927f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.217327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1825-39a5-4735-a884-6f0152927f2b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.217621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1825-39a5-4735-a884-6f0152927f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.217896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1825-39a5-4735-a884-6f0152927f2b None admin] PATH_INFO: `/v3/users/3878e9a9a6dd4465a3b24b0920d45de1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.219024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1825-39a5-4735-a884-6f0152927f2b None admin] RBAC: Authorizing `identity:get_user(user_id=3878e9a9a6dd4465a3b24b0920d45de1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.220482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1825-39a5-4735-a884-6f0152927f2b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.222099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 152/284] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/users/3878e9a9a6dd4465a3b24b0920d45de1 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.223188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.223472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.223745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.243227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:17.244441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:17.314785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 153/285] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:17.315549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.411743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742396ef-afd5-4e73-82fb-6c25e1d0bbc1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.444679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.445397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.445680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.445953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.447111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.448578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.450412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 154/286] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.456108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.564936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 133/287] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:16 2022] POST /identity/v3/users => generated 293 bytes in 772 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:17.577230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8a831-9a35-475a-9d52-040fbcb16c77 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.587661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.593934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.626914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.627601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.627882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.628156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66/users/3878e9a9a6dd4465a3b24b0920d45de1/roles/601c474f2bf14167a1b78810e368b2af` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.631382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] RBAC: Authorizing `identity:create_grant(project_id=bb857b819d5248abbc3caefd80918b66, user_id=3878e9a9a6dd4465a3b24b0920d45de1, role_id=601c474f2bf14167a1b78810e368b2af)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.633401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.640593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.703798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b268ae-56f8-4950-9428-f9f7cce1c608 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.742594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.743232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.743515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.743789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.748190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 155/288] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:17 2022] PUT /identity/v3/projects/bb857b819d5248abbc3caefd80918b66/users/3878e9a9a6dd4465a3b24b0920d45de1/roles/601c474f2bf14167a1b78810e368b2af => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:17.761980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:17.769257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:17.770244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:17.771053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:17.772497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 134/289] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:17.781959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.896582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.905794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c687-3cab-40b0-9be6-0d269dc138eb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.942416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.943225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.943543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.944221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.944966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:17.945314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.948063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.957681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 156/290] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.963795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:18.005286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:18.081074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c776a-4c60-4fe6-a6da-3e67d09896a2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:18.118416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:18.119049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:18.119326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:18.119597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] PATH_INFO: `/v3/users/65350f4c216d4221b302eac70a94b962` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:18.120740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] RBAC: Authorizing `identity:get_user(user_id=65350f4c216d4221b302eac70a94b962)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:18.122236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:18.124149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 135/291] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/users/65350f4c216d4221b302eac70a94b962 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:18.129840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:18.245326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269374ea-646e-4d7e-91b2-5ca741af6cce None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:18.280263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:18.280901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:18.281188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:18.281459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:18.307881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:18.363359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:18.364919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:18.494677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 157/292] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:18.500774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:18.626549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c023e-56a1-4790-ac15-f6d552ff2d74 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:18.629857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:18.674388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52167290-1f43-40c8-b219-879e67937b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:18.675042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167290-1f43-40c8-b219-879e67937b7e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:18.675322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167290-1f43-40c8-b219-879e67937b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:18.675599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167290-1f43-40c8-b219-879e67937b7e None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:18.676753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167290-1f43-40c8-b219-879e67937b7e None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:18.678295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167290-1f43-40c8-b219-879e67937b7e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:18.680469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 136/293] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:18 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:18.686698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:18.776700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:18.824453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daffde-c800-489b-8069-6e396d17337a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:18.865686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:18.866694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:18.867194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:18.867689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:18.868601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=65350f4c216d4221b302eac70a94b962) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:18.869175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:18.870878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6e0d-cb83-415c-b68d-18b67aa1349b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:18.879883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 158/294] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:18 2022] GET /identity/v3/role_assignments?user.id=65350f4c216d4221b302eac70a94b962&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:19.435450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79bb7d-a79e-448e-a13d-6c30be329c70 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:19.435842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79bb7d-a79e-448e-a13d-6c30be329c70 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:19.436068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79bb7d-a79e-448e-a13d-6c30be329c70 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:19.437518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 137/295] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:19.442920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715b742-9889-45ea-9a06-e133a3340b32 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:19.443358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715b742-9889-45ea-9a06-e133a3340b32 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:19.443527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715b742-9889-45ea-9a06-e133a3340b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:19.464034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8715b742-9889-45ea-9a06-e133a3340b32 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:19.465292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8715b742-9889-45ea-9a06-e133a3340b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:19.559912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 159/296] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:19.837526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79bb7d-a79e-448e-a13d-6c30be329c70 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:19.949789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79bb7d-a79e-448e-a13d-6c30be329c70 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:19.952463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a781cbe-ff7e-4cb1-8292-a1dcf4c9e23e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:19.952757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a781cbe-ff7e-4cb1-8292-a1dcf4c9e23e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:19.953081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a781cbe-ff7e-4cb1-8292-a1dcf4c9e23e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:19.956057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 160/297] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:19.960199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbb7f2-2525-430d-9b43-b6ac90e33096 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:19.960495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbb7f2-2525-430d-9b43-b6ac90e33096 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:19.960874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbb7f2-2525-430d-9b43-b6ac90e33096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:19.979359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8ecbb7f2-2525-430d-9b43-b6ac90e33096 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:19.980554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8ecbb7f2-2525-430d-9b43-b6ac90e33096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:19.991993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cab2b-33b3-4ef6-9110-831a9320440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:19.993435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cab2b-33b3-4ef6-9110-831a9320440e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:19.993550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cab2b-33b3-4ef6-9110-831a9320440e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:19.993746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cab2b-33b3-4ef6-9110-831a9320440e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.004452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cab2b-33b3-4ef6-9110-831a9320440e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3a0cab2b-33b3-4ef6-9110-831a9320440e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:20.009774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:20.010641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 138/298] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:20.013633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6f6f4-90a5-4ac6-80b4-b7babd17f8a4 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.014359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6f6f4-90a5-4ac6-80b4-b7babd17f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.014359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6f6f4-90a5-4ac6-80b4-b7babd17f8a4 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.014359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 139/299] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:20.019567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6f6f4-90a5-4ac6-80b4-b7babd17f8a4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.040503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.052597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.066309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 161/300] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:20.067641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.067928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.068207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.094371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:20.095893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:20.133605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6f6f4-90a5-4ac6-80b4-b7babd17f8a4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.173859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.174971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.175545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.176068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.177033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:20.184247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 162/301] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:20.184401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.184401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517673a-84a1-4143-b9d2-9fb2c3dc0e76 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.191816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 140/302] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:20.197782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.247456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5df24-49a5-432b-aa28-ee6f96ad3ca3 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.247737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5df24-49a5-432b-aa28-ee6f96ad3ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.248023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5df24-49a5-432b-aa28-ee6f96ad3ca3 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.249545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 141/303] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:20.254938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.255503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.255951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.275107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:20.276590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:20.313960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecf1b3-d94d-46dc-b81b-2492dc627ddb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.327017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.354111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.354670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.354949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.355222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] PATH_INFO: `/v3/users/587bb2ec244a4d4bacbba75c89c3c6fd` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.356471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] RBAC: Authorizing `identity:get_user(user_id=587bb2ec244a4d4bacbba75c89c3c6fd)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.358159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.359878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 163/304] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/users/587bb2ec244a4d4bacbba75c89c3c6fd => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:20.359878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.367377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 142/305] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:20.368687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.402563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.474947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcdefb-6933-4e8c-957f-2e65aab81497 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.497665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ea243-b48d-41e2-b78c-357bff2be3e6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.512026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.512697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.513009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.513289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.524098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:20.528982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:20.529859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:20.530704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 164/306] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:20.531359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.539360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.540445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.540979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.541473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] PATH_INFO: `/v3/system/users/587bb2ec244a4d4bacbba75c89c3c6fd/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.545644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=587bb2ec244a4d4bacbba75c89c3c6fd, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.547292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.577666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.638652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da454-9c5f-429f-93a7-95ad52a1f6f8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.657028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 143/307] 10.222.0.76 () {58 vars in 1334 bytes} [Wed Aug 31 19:07:20 2022] PUT /identity/v3/system/users/587bb2ec244a4d4bacbba75c89c3c6fd/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:20.657947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.678257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.678937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.679222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.679557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.692199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:20.697724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:20.698845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:20.699785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:20.702359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 165/308] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:20.703223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.771163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.785377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d2c6-cab9-4799-8f4d-2310994bf9d3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.816356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.821370 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11600b55-1552-4aed-b7bc-74948ef9ebe7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.825704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.826576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.826576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.826854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.829914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:20.829914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.829914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.844109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 144/309] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:20.845658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.864756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.865847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.866281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.866700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.869026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.870496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.872361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 166/310] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:20.872953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.956558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ec76-93ec-45fe-94a9-42dc0ca5cf7e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.995871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5db55-93ff-4765-84e3-754e712e483a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.996888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.997517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.997800 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.998102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.998802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:20.999110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.000534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.009779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 145/311] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:21.009779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:21.026733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:21.040425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.043873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.043873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.043873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] PATH_INFO: `/v3/users/3878e9a9a6dd4465a3b24b0920d45de1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.043873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3878e9a9a6dd4465a3b24b0920d45de1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.044499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.050864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 167/312] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/users/3878e9a9a6dd4465a3b24b0920d45de1 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:21.050864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:21.094729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:21.133420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0deb12-9785-479f-8723-0669c6570834 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:21.169237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.169939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.170215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.170517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] PATH_INFO: `/v3/groups` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.171165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.172845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.180411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50049e4-9230-493d-9a23-c9aedb50d0e3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:21.216671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.217260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.217545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.217822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] PATH_INFO: `/v3/users/0006df6fc5c340ebb114e41ec113c2e8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.232879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] RBAC: Authorizing `identity:get_user(user_id=0006df6fc5c340ebb114e41ec113c2e8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.234284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.235934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 168/313] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:21 2022] GET /identity/v3/users/0006df6fc5c340ebb114e41ec113c2e8 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:21.240828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:21.260833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 146/314] 10.222.0.76 () {60 vars in 1134 bytes} [Wed Aug 31 19:07:21 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:21.260833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:21.352922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:21.372961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:21.386165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e370-081b-4116-a546-be64d39d5923 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:21.406791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427501-c952-48e7-92ae-bcb102057e6f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:21.426013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.426629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.426965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.427205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.449195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.453439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.453439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.453439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.453439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] RBAC: Adding query filter params (role.id=601c474f2bf14167a1b78810e368b2af, user.id=0006df6fc5c340ebb114e41ec113c2e8, scope.system=all) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:21.453439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.453439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.459301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 147/315] 10.222.0.76 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:21 2022] GET /identity/v3/role_assignments?user.id=0006df6fc5c340ebb114e41ec113c2e8&scope.system=all&role.id=601c474f2bf14167a1b78810e368b2af => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:21.512122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.513545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.627214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:21.636919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 169/316] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:21.645919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:21.754429 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b7737-b132-4625-b662-c40c75a7c756 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:21.789516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275ee9-f150-4a99-a87a-0f52d1e139d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.790079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275ee9-f150-4a99-a87a-0f52d1e139d2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.790366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275ee9-f150-4a99-a87a-0f52d1e139d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.790648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275ee9-f150-4a99-a87a-0f52d1e139d2 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.791814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8275ee9-f150-4a99-a87a-0f52d1e139d2 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.793317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8275ee9-f150-4a99-a87a-0f52d1e139d2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.794992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 148/317] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:21 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:21.801874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:21.910356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7b804-7e79-4c0b-bd98-b3733fd5be98 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:21.945847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:21.946613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:21.946901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:21.947177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:21.947904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] RBAC: Adding query filter params (role.id=601c474f2bf14167a1b78810e368b2af, scope.project.id=bb857b819d5248abbc3caefd80918b66, user.id=3878e9a9a6dd4465a3b24b0920d45de1) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:21.948211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:21.949728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b93be-0cc6-4815-ab71-9647305ac60a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:21.956195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 170/318] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:21 2022] GET /identity/v3/role_assignments?user.id=3878e9a9a6dd4465a3b24b0920d45de1&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=601c474f2bf14167a1b78810e368b2af => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:22.741511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33db3-c053-4a6d-80cd-ae13224df3c0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:22.742529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33db3-c053-4a6d-80cd-ae13224df3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:22.742631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33db3-c053-4a6d-80cd-ae13224df3c0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:22.744096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 149/319] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:22.749376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d3f1-bb64-4857-aca9-3d15a397fe5b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:22.749778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d3f1-bb64-4857-aca9-3d15a397fe5b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:22.749939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d3f1-bb64-4857-aca9-3d15a397fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:22.769436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8f72d3f1-bb64-4857-aca9-3d15a397fe5b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:22.770670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8f72d3f1-bb64-4857-aca9-3d15a397fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:22.823314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:22.851168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 171/320] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:23.137750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33db3-c053-4a6d-80cd-ae13224df3c0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:23.141637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:23.293542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33db3-c053-4a6d-80cd-ae13224df3c0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:23.328556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197c2b-6717-456b-bf10-c375fa02aa4f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.329130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197c2b-6717-456b-bf10-c375fa02aa4f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.329409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197c2b-6717-456b-bf10-c375fa02aa4f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.329736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:23.330519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.331857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.332032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 172/321] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:23.332154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.336142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.336426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.336697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.344298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:23.350471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:23.351977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:23.352994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 150/322] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:23.357987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:23.359456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:23.359631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:23.427552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:23.433254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 173/323] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:23.467100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57170d4-411b-47ac-9778-e8f47cfc25a8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:23.502244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:23.502880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.503163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.503437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.504190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:23.504502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:23.506006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb13c-63bb-4676-b694-7338eca4e10b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:23.520101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 151/324] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:23.521421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:23.621838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f13ed8-7ef0-4514-a818-a3dc5a66b3d4 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.622146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f13ed8-7ef0-4514-a818-a3dc5a66b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.622396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f13ed8-7ef0-4514-a818-a3dc5a66b3d4 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.623731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 152/325] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:23.628651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.628972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.629250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.644123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf459c-1308-4da3-a4ab-c0ede88bed33 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:23.647840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:23.649644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:23.665054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:23.685209 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:23.685830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.686152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.686536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] PATH_INFO: `/v3/users/587bb2ec244a4d4bacbba75c89c3c6fd` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.687805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] RBAC: Authorizing `identity:get_user(user_id=587bb2ec244a4d4bacbba75c89c3c6fd)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:23.689457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:23.691434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 174/326] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:23 2022] GET /identity/v3/users/587bb2ec244a4d4bacbba75c89c3c6fd => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:23.697188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:23.723174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 153/327] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:23.724015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:23.786797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:23.812218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00701-c7a6-4a24-a5e8-09ffaa3438bd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:23.833513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e87e9d-d7d3-427a-bc93-563996aef45a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:23.848020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:23.848653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.848972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.849251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.849982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] RBAC: Adding query filter params (role.id=30e479ab3dee4ac3aeb96b4eb87bb666, user.id=587bb2ec244a4d4bacbba75c89c3c6fd, scope.system=all) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:23.850297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:23.852282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:23.864976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 175/328] 10.222.0.76 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:23 2022] GET /identity/v3/role_assignments?user.id=587bb2ec244a4d4bacbba75c89c3c6fd&scope.system=all&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:23.870915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:23.871617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.871902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.872182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.873578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:23.875141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:23.877101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 154/329] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:23.882953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:23.935626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:23.995864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.007113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989edb3c-396f-4c5f-a79d-a9b68e27cc73 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.044128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6206c-12f2-4a00-b728-298bbc030cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.044786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6206c-12f2-4a00-b728-298bbc030cb6 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.045168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6206c-12f2-4a00-b728-298bbc030cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.045446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6206c-12f2-4a00-b728-298bbc030cb6 None admin] PATH_INFO: `/v3/groups` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.046605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6206c-12f2-4a00-b728-298bbc030cb6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.048036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6206c-12f2-4a00-b728-298bbc030cb6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.106708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e659711-aaf2-4fef-8055-324d8f4c8046 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.129954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.140724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.141360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.141636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.141903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.151315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:24.156028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:24.157090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:24.157975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 155/330] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:24.162824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.258342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760613b-cec3-4ec6-b45d-ad64eac1b304 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.290159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.290746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.291026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.291305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.291962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:24.292288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.293679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.301271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 156/331] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:24.307303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.399339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78c2d-1381-41e7-847b-4f179eb28941 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.431460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.432117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.432364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.432641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] PATH_INFO: `/v3/users/0006df6fc5c340ebb114e41ec113c2e8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.433773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] RBAC: Authorizing `identity:get_user(user_id=0006df6fc5c340ebb114e41ec113c2e8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.435178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.436733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 157/332] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/users/0006df6fc5c340ebb114e41ec113c2e8 => generated 293 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:24.442279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.501297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 176/333] 10.222.0.76 () {60 vars in 1134 bytes} [Wed Aug 31 19:07:23 2022] POST /identity/v3/groups => generated 226 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:24.537825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.550031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523c50-5c5d-4cae-a433-36b4e1c9e803 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.588130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561fdec-4190-4f54-8c4e-5482ecad5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.588793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561fdec-4190-4f54-8c4e-5482ecad5f28 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.589103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561fdec-4190-4f54-8c4e-5482ecad5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.589382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561fdec-4190-4f54-8c4e-5482ecad5f28 None admin] PATH_INFO: `/v3/system/users/0006df6fc5c340ebb114e41ec113c2e8/roles/601c474f2bf14167a1b78810e368b2af` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.590858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561fdec-4190-4f54-8c4e-5482ecad5f28 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0006df6fc5c340ebb114e41ec113c2e8, role_id=601c474f2bf14167a1b78810e368b2af)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.592268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561fdec-4190-4f54-8c4e-5482ecad5f28 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.640099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.679767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 158/334] 10.222.0.76 () {58 vars in 1334 bytes} [Wed Aug 31 19:07:24 2022] PUT /identity/v3/system/users/0006df6fc5c340ebb114e41ec113c2e8/roles/601c474f2bf14167a1b78810e368b2af => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:26.698059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63e9e-fa1d-4e5e-bf53-99671e266b22 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.699067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63e9e-fa1d-4e5e-bf53-99671e266b22 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.699600 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63e9e-fa1d-4e5e-bf53-99671e266b22 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.701186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 177/335] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:26.707948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7f9c2-6fe5-4b70-83d8-2da2da44c041 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.708836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7f9c2-6fe5-4b70-83d8-2da2da44c041 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.709322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7f9c2-6fe5-4b70-83d8-2da2da44c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.733812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-79d7f9c2-6fe5-4b70-83d8-2da2da44c041 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:26.735457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-79d7f9c2-6fe5-4b70-83d8-2da2da44c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:26.817139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 159/336] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:26.886415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe4d6e-5d4e-4081-96b4-3e72c480ee6f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.887058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe4d6e-5d4e-4081-96b4-3e72c480ee6f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.887569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe4d6e-5d4e-4081-96b4-3e72c480ee6f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.889168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 178/337] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:26.894380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae6b77-7cb0-41a1-b676-14724be2b5bd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.894892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae6b77-7cb0-41a1-b676-14724be2b5bd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.895366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae6b77-7cb0-41a1-b676-14724be2b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.918864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bbae6b77-7cb0-41a1-b676-14724be2b5bd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:26.920058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bbae6b77-7cb0-41a1-b676-14724be2b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:27.012130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 160/338] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:27.242972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb26e0-f0aa-438c-9f18-d2ef63f6bd13 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.243635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb26e0-f0aa-438c-9f18-d2ef63f6bd13 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.244136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb26e0-f0aa-438c-9f18-d2ef63f6bd13 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.245725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 179/339] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:27.251395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.251683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.251956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.273734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:27.395042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:27.395042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.395042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 161/340] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:27.395287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb26e0-f0aa-438c-9f18-d2ef63f6bd13 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.420273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.498046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb26e0-f0aa-438c-9f18-d2ef63f6bd13 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.499647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.548286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0f13d-41ba-4c26-b047-283f74d7d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.549374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f13d-41ba-4c26-b047-283f74d7d270 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.549666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f13d-41ba-4c26-b047-283f74d7d270 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.550521 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f13d-41ba-4c26-b047-283f74d7d270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.568261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0f13d-41ba-4c26-b047-283f74d7d270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-80d0f13d-41ba-4c26-b047-283f74d7d270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:27.575138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:27.576037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:27.576842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:27.580536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 180/341] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:27.583903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb143a-a45b-4b00-8648-373258a2f55c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.584460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb143a-a45b-4b00-8648-373258a2f55c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.586185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb143a-a45b-4b00-8648-373258a2f55c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.587322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 181/342] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:27.588417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb143a-a45b-4b00-8648-373258a2f55c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.629978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9f28-4fc8-4f55-ae82-77a25ffb6127 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.718879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecae7-2df9-404d-b93c-c8905716e1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.719630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecae7-2df9-404d-b93c-c8905716e1cd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.719792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecae7-2df9-404d-b93c-c8905716e1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.720035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecae7-2df9-404d-b93c-c8905716e1cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.747855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aecae7-2df9-404d-b93c-c8905716e1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f9aecae7-2df9-404d-b93c-c8905716e1cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:27.760729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:27.763181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 162/343] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:27.765166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.766965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.766965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.770610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb143a-a45b-4b00-8648-373258a2f55c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.812108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:27.813373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:27.838834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.839847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.840323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.840792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.841990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:27.842504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:27.842756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.844684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:27.854484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 182/344] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:27.855315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.909233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.917652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 163/345] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:27.918706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.995577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e241-5705-4e4a-9aad-4cda743f6cbb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.033115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3cad9-2ab5-4228-a9af-ad052da99ed2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.059314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.060357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.060862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.061336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.062519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:28.063049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.067879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.071146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.071807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.072103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.072419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.091996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 183/346] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.092942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.143655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.225490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.227733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.261796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.292785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2602-abe9-4390-878a-2b3a90bc0b1e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.343818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.345226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.345729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.346576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.364420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:28.372441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:28.373516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:28.374582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:28.375347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 164/347] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:28.375736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.376918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 184/348] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:28.377890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.455720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.517960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32066f-58d5-41b9-9b4d-66cf3a5b4486 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.518494 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21320781-be1a-481d-9314-00f4a9560ad3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.566298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.567268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.567819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.568269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] PATH_INFO: `/v3/users/0006df6fc5c340ebb114e41ec113c2e8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.569910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=0006df6fc5c340ebb114e41ec113c2e8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.570511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.571245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.571558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.571875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.572434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.574414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 165/349] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/users/0006df6fc5c340ebb114e41ec113c2e8 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.575458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.591270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:28.598831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:28.599744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 185/350] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:28.600756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.613089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.704672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4c65c-f655-4c0d-bc51-26172b45b5e2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.740161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.745462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7599-f50b-4b6f-b387-3baa7a1fd879 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.752445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.753166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.753451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.753727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.754903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.759049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.760968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 166/351] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.762172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.795492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.796113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.796306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.796583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.797305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:28.797603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.799003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.809101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 186/352] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.809997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.889874 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7381e-3689-44c0-b310-906343210ac2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.897571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.933616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.934279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.934566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.934956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.935188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc857-7376-4f46-ba4d-59c17aba94f5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.935753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] RBAC: Adding query filter params (role.id=601c474f2bf14167a1b78810e368b2af, user.id=0006df6fc5c340ebb114e41ec113c2e8, scope.system=all) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:28.936092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.938293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7e8e-eec8-4496-acb7-43a714528518 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.951176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 167/353] 10.222.0.76 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/role_assignments?user.id=0006df6fc5c340ebb114e41ec113c2e8&scope.system=all&role.id=601c474f2bf14167a1b78810e368b2af => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.952446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c1aae-47e2-4cc7-a27c-cae7d3455844 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.952735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c1aae-47e2-4cc7-a27c-cae7d3455844 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.953047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c1aae-47e2-4cc7-a27c-cae7d3455844 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.954561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 168/354] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:28.955225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c1aae-47e2-4cc7-a27c-cae7d3455844 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.980001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.980651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.980972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.981252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.982445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:28.982445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.983693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.998592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 187/355] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.999856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.037165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.135540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c1aae-47e2-4cc7-a27c-cae7d3455844 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.174256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe11d8-1658-4d71-b400-9e43eb070ec2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.208455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ba84f-88fb-46af-9157-bbc3b0099353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.209669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ba84f-88fb-46af-9157-bbc3b0099353 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.212298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ba84f-88fb-46af-9157-bbc3b0099353 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.212758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ba84f-88fb-46af-9157-bbc3b0099353 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.214967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.227932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ba84f-88fb-46af-9157-bbc3b0099353 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.229413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.234410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ba84f-88fb-46af-9157-bbc3b0099353 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.234522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.234522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.234522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.236935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 169/356] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:29.239862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506311-a8a4-4bef-b0f9-efee57317fe9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.240001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506311-a8a4-4bef-b0f9-efee57317fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.240372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506311-a8a4-4bef-b0f9-efee57317fe9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.242935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 170/357] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:29.244628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.245149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.245612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.274846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:29.277210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:29.358211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.361284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.400081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 171/358] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:29.404315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.497191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.541720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 188/359] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:29.542742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.605478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.618133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9cf2-1dd1-4803-8d7b-1a5f82d2e7b5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.684428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.685058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.685371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.685733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.750701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758483f-c3c5-404f-b272-a400040e72fc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.810423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.813115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.813785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.814449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.814669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.814944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.815685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=5b9ee288e46e40168538694a0221a807) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:29.815993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.817700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d881581-356d-4163-af57-b5c140006ea0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.828335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 189/360] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:29.832200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.834969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.835336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.863299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:29.864556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:29.908522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.984136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 190/361] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:29.988901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.004034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 172/362] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:30.005208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.031779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.146569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840654-1d59-455d-83fa-357ea1c9e360 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.163693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1ee4a-5901-4b57-b86f-09d827d9209a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.199594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.200250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.200673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.201017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.219588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:30.224464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:30.224640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:30.225516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:30.226526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 173/363] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:30.227500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.229036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.231301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.231889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.233619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.235595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.237018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.238930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 191/364] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.239981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.350385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a636a9-b0ba-4605-ac73-5d00241f39f2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.362597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.375733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62ebb6-54c7-4c1c-aa18-75aa031c6f68 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.399489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.400489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.403135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.403420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.405730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.409607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.411569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 174/365] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.416498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.422527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.423273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.423624 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.424008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.424774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:30.425182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.427004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.441138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 192/366] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.441138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.518903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.560134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350379-2268-4b85-ab60-ab270e384916 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.573953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e317-ceef-40bc-b278-536e03965207 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.604077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.605832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.606594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.607075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.609185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.611173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.613041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 175/367] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.613886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.615274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.615919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.616203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.616481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.630944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:30.636399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:30.637445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:30.638427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:30.639125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 193/368] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:30.639957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.663664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.747210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ab5c5-0c1c-4fba-8489-45efff81bd77 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.784450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596972b-ce4a-4740-a509-a499fcedb49b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.787631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.788304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.788615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.788966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.790444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.791999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.793766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 176/369] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.794369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.809881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.816294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.821191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.821513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.821803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.911435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.912933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.931553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4355-e518-4cbf-89e1-a8e86ab524c9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.932734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.978182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.979125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.979406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.979676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.980529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=bb857b819d5248abbc3caefd80918b66) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:30.981018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.982480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.988935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 177/370] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.989748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.034678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 194/371] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:31.035473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.094028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.123980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e0ac-490d-4b70-a287-75adccc83ef2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.176976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456642-6266-42cb-8883-b4fc307084bd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.179128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.180272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.180549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.180835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.181575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:31.181873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.183333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.195628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 178/372] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:31.196765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.204295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.243283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.243897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.244184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.244461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.245259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=5b9ee288e46e40168538694a0221a807) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:31.245572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.247026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.253296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 195/373] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:31.254118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.328769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf65de-05ac-4ebc-9b20-23c68be4e4b4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.371182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.371834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.372116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.372390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.374205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.376010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.378279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 179/374] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:31.387392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.396202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.492911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160d5c-9a64-4d96-bad4-1616b06eb4c7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.534960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.535690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.535981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.536260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.559680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c666b-d184-403f-9438-1e0364a3795e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.597303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.601862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.602511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.602798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.603106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.604732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.606808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.609870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 180/375] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:31.617922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.625205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.626714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.704944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.748547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 196/376] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:31.754220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.782745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c060ae-2dd0-4507-a68d-b678d8a50f06 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.853590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.854411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.854847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.855271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.856427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=bb857b819d5248abbc3caefd80918b66) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:31.856938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.860103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.869780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 181/377] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:31.885201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.945109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8bc2a-fd0c-4237-9e85-f2b826b6201b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.005666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db560901-82d7-4a92-bbc0-48853c26a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.006338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db560901-82d7-4a92-bbc0-48853c26a747 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.006620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db560901-82d7-4a92-bbc0-48853c26a747 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.006895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db560901-82d7-4a92-bbc0-48853c26a747 None admin] PATH_INFO: `/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.008254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db560901-82d7-4a92-bbc0-48853c26a747 None admin] RBAC: Authorizing `identity:get_project(project_id=c50ebd1d38a64d4a92701ba8958dbdd4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.009748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db560901-82d7-4a92-bbc0-48853c26a747 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.011487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 197/378] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:32.017301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.074424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1949b6-85be-447b-8a07-6ea7c54c00de None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.074758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1949b6-85be-447b-8a07-6ea7c54c00de None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.074973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1949b6-85be-447b-8a07-6ea7c54c00de None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.076611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 198/379] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:32.082094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.082332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.082591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.115366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:32.116678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:32.139803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f02fa-dace-4973-a8f6-7e9a7a2953fe None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.175446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.176083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.176362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.176631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] PATH_INFO: `/v3/groups/f6eb4231588b421aa692d8ef81adcb84` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.179563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.182076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] RBAC: Authorizing `identity:get_group(group_id=f6eb4231588b421aa692d8ef81adcb84)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.183542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.185311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 182/380] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/groups/f6eb4231588b421aa692d8ef81adcb84 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:32.191273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.259431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 199/381] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:32.312728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525806d8-c2bc-4b3f-88d2-1ccb33fd4783 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.347650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.348265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.348547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.348837 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.349576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] RBAC: Adding query filter params (group.id=f6eb4231588b421aa692d8ef81adcb84, role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=c50ebd1d38a64d4a92701ba8958dbdd4) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:32.349885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.351991 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.364965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 183/382] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/role_assignments?group.id=f6eb4231588b421aa692d8ef81adcb84&scope.project.id=c50ebd1d38a64d4a92701ba8958dbdd4&role.id=a3733baec72d443ab044f15928e9f85d => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:32.644875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.749224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.781313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e30a5-3beb-4448-9388-3094cc312ba1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.834518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.836083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.836568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.837056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.852385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:32.857343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:32.858256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:32.859048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 200/383] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:32.866085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.963190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:33.001633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585820b-4d70-45df-9749-061404c2dda4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.035912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.036530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.036796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.037093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.037760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:33.038062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.039518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.048494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 184/384] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:33.054877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.230263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14c714-b48d-4fe2-af4a-6503ea79b90f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.280260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.281042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.281332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.281616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.284016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.285556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.287565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 201/385] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:33 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:33.294112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.435279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24792747-5c5b-48af-a748-c662ba7e7497 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.465492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:33.474207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1cf9b-0ccc-4415-8a83-46fa5578bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.474866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1cf9b-0ccc-4415-8a83-46fa5578bef5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.475146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1cf9b-0ccc-4415-8a83-46fa5578bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.475414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1cf9b-0ccc-4415-8a83-46fa5578bef5 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.476731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1cf9b-0ccc-4415-8a83-46fa5578bef5 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.482424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1cf9b-0ccc-4415-8a83-46fa5578bef5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.482424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 185/386] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:33 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:33.488837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.497993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:33.542331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1d11-60a1-4fbc-8ed5-7c5834e2b37e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.542631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1d11-60a1-4fbc-8ed5-7c5834e2b37e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.543009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1d11-60a1-4fbc-8ed5-7c5834e2b37e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.544769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 186/387] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:33.550357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59624347-c92e-4485-8744-6253a227d27d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.550641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59624347-c92e-4485-8744-6253a227d27d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.550922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59624347-c92e-4485-8744-6253a227d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.594050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-59624347-c92e-4485-8744-6253a227d27d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:33.595278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-59624347-c92e-4485-8744-6253a227d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:33.698684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbe221-abe6-46e9-8087-05404dc50552 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.736044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 187/388] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:33.751780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc1cb7-099a-4a7f-be2d-5f4d0ade7dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.752462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc1cb7-099a-4a7f-be2d-5f4d0ade7dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.752747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc1cb7-099a-4a7f-be2d-5f4d0ade7dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.753248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc1cb7-099a-4a7f-be2d-5f4d0ade7dc9 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807/groups/7c6dda1d59c84420990ae6758c440564/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.757644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc1cb7-099a-4a7f-be2d-5f4d0ade7dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ee288e46e40168538694a0221a807, group_id=7c6dda1d59c84420990ae6758c440564, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.759128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc1cb7-099a-4a7f-be2d-5f4d0ade7dc9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.845407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 202/389] 10.222.0.76 () {58 vars in 1442 bytes} [Wed Aug 31 19:07:33 2022] PUT /identity/v3/projects/5b9ee288e46e40168538694a0221a807/groups/7c6dda1d59c84420990ae6758c440564/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:33.911452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519ee1-e2ed-4bce-9c5e-45e8f7eb4c35 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.911780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519ee1-e2ed-4bce-9c5e-45e8f7eb4c35 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.912091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519ee1-e2ed-4bce-9c5e-45e8f7eb4c35 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.913986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 188/390] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:33.919747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedc5e1-5c45-4278-b6be-3d29b8390392 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.920043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedc5e1-5c45-4278-b6be-3d29b8390392 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.920308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedc5e1-5c45-4278-b6be-3d29b8390392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.940471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0bedc5e1-5c45-4278-b6be-3d29b8390392 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:33.941721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0bedc5e1-5c45-4278-b6be-3d29b8390392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:34.009201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.018139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 203/391] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:34.077777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519ee1-e2ed-4bce-9c5e-45e8f7eb4c35 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.174804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d0fe5-17d2-4ec3-b546-52a7912afe24 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.175308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d0fe5-17d2-4ec3-b546-52a7912afe24 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.175416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d0fe5-17d2-4ec3-b546-52a7912afe24 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.176831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 204/392] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:34.182458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.182744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.183037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.201115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519ee1-e2ed-4bce-9c5e-45e8f7eb4c35 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.205652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:34.206856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:34.230820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.248388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.251337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.251337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.251337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.261054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:34.266003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:34.266866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:34.267656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 189/393] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:34.280114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.293292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 205/394] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:34.373718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.494694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b4b2-d028-423c-b0a1-6ac020dfb300 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.542087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932cd85-bef9-4ec0-8f11-ad46e656b649 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.561208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.561857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.562132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.562517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.563076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:34.563426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.564829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.584231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 190/395] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:34.588319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.589828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.613084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.613716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.614054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.629142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.633933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:34.639292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:34.640158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:34.640952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 206/396] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:34.641622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.656458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.720131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d68c8-5989-4099-aa6a-0b7bb355dafb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.762772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.763823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.764153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.764645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.766072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.768289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.769488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c6c5-9a5a-4e92-be06-2426f40f795b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.770301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 191/397] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:34.771089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.819886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.820634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.821013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.821353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.836171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:34.843417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:34.845550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 207/398] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:34.847464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.890545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5f74-f4c0-4cec-84d4-3a9a586325fd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.906072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.908951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.929245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.929862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.930147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.930428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.931189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:34.931504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.932967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.941807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 192/399] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:34.942646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.972263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eef0f-02aa-46e5-9988-7b938f15894c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.007421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1208f2-93a0-4f89-ad94-46c1f24a65e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.008065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1208f2-93a0-4f89-ad94-46c1f24a65e6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.008383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1208f2-93a0-4f89-ad94-46c1f24a65e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.008622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1208f2-93a0-4f89-ad94-46c1f24a65e6 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.009912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1208f2-93a0-4f89-ad94-46c1f24a65e6 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.011406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1208f2-93a0-4f89-ad94-46c1f24a65e6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.013079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 208/400] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:35.014194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d21bf-d440-4651-8c73-bfda67a24650 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.014475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d21bf-d440-4651-8c73-bfda67a24650 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.014751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d21bf-d440-4651-8c73-bfda67a24650 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.016137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 209/401] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:35.016710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d21bf-d440-4651-8c73-bfda67a24650 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.069147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac7635-24af-4f2f-b5ce-894d5f338f2d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.107992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.107992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.107992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.107992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.108995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:35.108995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.109858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.124430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 193/402] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:35.124430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.137155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d21bf-d440-4651-8c73-bfda67a24650 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.151647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.168775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.175333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b1fd-fc7a-48e9-8a3d-b0665475752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.176278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b1fd-fc7a-48e9-8a3d-b0665475752a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.176278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b1fd-fc7a-48e9-8a3d-b0665475752a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.176579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b1fd-fc7a-48e9-8a3d-b0665475752a None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.177765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b1fd-fc7a-48e9-8a3d-b0665475752a None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.179485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b1fd-fc7a-48e9-8a3d-b0665475752a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.186043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 210/403] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:35.186043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.186043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.186043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.204592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:35.205825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:35.254519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabb592-f9c5-49ad-9785-521863ac320c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.292834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 211/404] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:35.292834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.307308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.308031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.308317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.308597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66/groups/7c6dda1d59c84420990ae6758c440564/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.310646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb857b819d5248abbc3caefd80918b66, group_id=7c6dda1d59c84420990ae6758c440564, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.312127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.392056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b32d-f7bf-45ac-bfba-8741ae8b0786 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.396138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 194/405] 10.222.0.76 () {58 vars in 1442 bytes} [Wed Aug 31 19:07:35 2022] PUT /identity/v3/projects/bb857b819d5248abbc3caefd80918b66/groups/7c6dda1d59c84420990ae6758c440564/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:35.400000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.406899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.434816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e4307-2513-4277-835e-602be3583117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.435672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4307-2513-4277-835e-602be3583117 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.435888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4307-2513-4277-835e-602be3583117 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.436248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4307-2513-4277-835e-602be3583117 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.437476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e4307-2513-4277-835e-602be3583117 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.439167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e4307-2513-4277-835e-602be3583117 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.441264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 212/406] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:35.449168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e4307-2513-4277-835e-602be3583117 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.529357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.534326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073aea3-a26d-4bef-9a37-b589d3811c01 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.561757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e4307-2513-4277-835e-602be3583117 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.585856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.587052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.587577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.588060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.593686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.595596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.597617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 195/407] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:35.604659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.604961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.605486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.605944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.606307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.607565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.609217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.611225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 213/408] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:35.618861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.700128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.733746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306008-31d0-4023-a935-2690d7c3bff3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.775325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070dccf-0eab-4d04-9e01-392623cebe69 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.775535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.776151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.776437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.776905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807/groups/7c6dda1d59c84420990ae6758c440564/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.780049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ee288e46e40168538694a0221a807, group_id=7c6dda1d59c84420990ae6758c440564, role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.781577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.813082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.813855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.814143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.814470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66/groups/7c6dda1d59c84420990ae6758c440564/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.816686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb857b819d5248abbc3caefd80918b66, group_id=7c6dda1d59c84420990ae6758c440564, role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.818192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.896656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 196/409] 10.222.0.76 () {58 vars in 1442 bytes} [Wed Aug 31 19:07:35 2022] PUT /identity/v3/projects/5b9ee288e46e40168538694a0221a807/groups/7c6dda1d59c84420990ae6758c440564/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:35.897350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.925475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 214/410] 10.222.0.76 () {58 vars in 1442 bytes} [Wed Aug 31 19:07:35 2022] PUT /identity/v3/projects/bb857b819d5248abbc3caefd80918b66/groups/7c6dda1d59c84420990ae6758c440564/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:35.942486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.032142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efe8a0-b9fe-4e51-a964-12929395aa87 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.076670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b16e-fcba-4dd5-8f36-387b195a12d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.077389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b16e-fcba-4dd5-8f36-387b195a12d7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.077678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b16e-fcba-4dd5-8f36-387b195a12d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.077957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b16e-fcba-4dd5-8f36-387b195a12d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.091182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447b16e-fcba-4dd5-8f36-387b195a12d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1447b16e-fcba-4dd5-8f36-387b195a12d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:36.096273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:36.097220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:36.098125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 197/411] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:36.104203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.230181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835146-8030-4ca6-a40f-e578cad2e338 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.230704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835146-8030-4ca6-a40f-e578cad2e338 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.230704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835146-8030-4ca6-a40f-e578cad2e338 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.232203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 198/412] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:36.232967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c47b-d076-4a95-9d63-51f7905e7a65 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.238233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.238782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.239268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.241948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.261762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:36.263035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:36.273159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.274183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.274682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.275147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.276022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:36.276517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.278218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.294084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 215/413] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:36.300433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.388022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 199/414] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:36.452101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af2e9-8bf1-4b93-bac2-cb0c953ff65b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.490966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.492378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.492664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.492988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] PATH_INFO: `/v3/groups/f6eb4231588b421aa692d8ef81adcb84` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.497473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] RBAC: Authorizing `identity:get_group(group_id=f6eb4231588b421aa692d8ef81adcb84)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.498938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.500882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 216/415] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/groups/f6eb4231588b421aa692d8ef81adcb84 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:36.506264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.547029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.649024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed46ec-b724-4a00-9d65-0ea465696ce1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.685043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.685846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.686233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.686610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] PATH_INFO: `/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.687861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] RBAC: Authorizing `identity:get_project(project_id=c50ebd1d38a64d4a92701ba8958dbdd4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.689446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.691525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 200/416] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:36.697579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.738939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.786413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.843985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.849367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca621df-8f31-4d45-b402-947b13862743 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.885722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.886476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.886764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.887048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.900040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:36.905283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:36.906248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:36.907090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 201/417] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:36.913750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.954869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf7e1-d195-4243-b212-84a1038e780e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.013940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.014924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.015210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.015486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] PATH_INFO: `/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4/groups/f6eb4231588b421aa692d8ef81adcb84/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.017434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=c50ebd1d38a64d4a92701ba8958dbdd4, group_id=f6eb4231588b421aa692d8ef81adcb84, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.019554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.087809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036b67e-f40f-445b-97d5-a95a9b8a7867 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.124780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.125386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.125671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.125950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.126622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:37.126930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.128464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.143088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 202/418] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:37.144387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.153149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 217/419] 10.222.0.76 () {58 vars in 1442 bytes} [Wed Aug 31 19:07:36 2022] PUT /identity/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4/groups/f6eb4231588b421aa692d8ef81adcb84/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:37.155786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.267631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e980a-6d5d-4041-9906-e18ce0e98614 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.308161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.308825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.309145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.309481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.384983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.386401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.398134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.503340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 203/420] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:37.504948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.629580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.636603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb035-10be-40c7-8694-b9db6e896a28 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.682855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.683509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.683823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.684138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.687197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.688744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.690939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 218/421] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:37.697532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.832470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c6c9-e5de-4e54-8ee7-307522e5326d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.849243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.870331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef371d4-e062-43c3-948e-c91763c19ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.870995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef371d4-e062-43c3-948e-c91763c19ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.871281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef371d4-e062-43c3-948e-c91763c19ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.871604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef371d4-e062-43c3-948e-c91763c19ba2 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.872730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef371d4-e062-43c3-948e-c91763c19ba2 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.874329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef371d4-e062-43c3-948e-c91763c19ba2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.880843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 204/422] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:37.882948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.944916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d32779-b68f-42c7-9594-a1da2ee1022d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.945197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d32779-b68f-42c7-9594-a1da2ee1022d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.945504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d32779-b68f-42c7-9594-a1da2ee1022d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.947686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 205/423] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:37.955738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fec09-e588-4765-bbaa-63f59c6f376c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.956022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fec09-e588-4765-bbaa-63f59c6f376c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.956296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fec09-e588-4765-bbaa-63f59c6f376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.985502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b58fec09-e588-4765-bbaa-63f59c6f376c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:37.986700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b58fec09-e588-4765-bbaa-63f59c6f376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:38.075714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db0941-3b32-4c1d-88cb-0a302a3a48ec None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.107168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 206/424] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:38.121419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.122062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.122319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.122593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.123390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=5b9ee288e46e40168538694a0221a807) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:38.123703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.125227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c399494-3c62-49e2-a078-be4c0abbf0b1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.135725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 219/425] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:38.404024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaed03-2e66-4b7c-b178-7e8f2986b00d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.404538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaed03-2e66-4b7c-b178-7e8f2986b00d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.404615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaed03-2e66-4b7c-b178-7e8f2986b00d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.406302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 207/426] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:38.411731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e89dd-6519-4454-a232-57f79658d44a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.412031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e89dd-6519-4454-a232-57f79658d44a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.412312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e89dd-6519-4454-a232-57f79658d44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.432602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-079e89dd-6519-4454-a232-57f79658d44a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:38.433880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-079e89dd-6519-4454-a232-57f79658d44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:38.458349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaed03-2e66-4b7c-b178-7e8f2986b00d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.462501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.535371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 220/427] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:38.572598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b236-b997-4262-a93e-e967502fe464 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.573112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b236-b997-4262-a93e-e967502fe464 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.573405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b236-b997-4262-a93e-e967502fe464 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.575136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 221/428] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:38.580749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.580749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.580749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.596091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaed03-2e66-4b7c-b178-7e8f2986b00d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.606849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:38.608667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:38.609166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.646390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.647170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.647557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.647886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.664157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:38.670422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:38.676328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:38.677261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 208/429] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:38.679824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.707785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 222/430] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:38.790854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca4f6-88b0-4f42-a561-3592d4edc8b6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.827015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.827995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.828737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.829233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.830105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:38.830631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.832212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.843966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 209/431] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:38.844499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.847721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.883758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.963470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.979775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c9803-3ad3-4ade-97bb-33a3cf2ccfa8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.991028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d7f41-0a04-485a-b123-093f0fa236f6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.020314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.021152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.021445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.021725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.042931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:39.045580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.046207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.046641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.046924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:39.047775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:39.048604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:39.049463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 223/432] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:39.050101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.133630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.135725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.165086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.168594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20878cd1-b1e1-4171-a61b-739355e8104b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.208524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.209434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.209633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.210533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:39.234886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:39.235755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:39.236587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 224/433] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:39.237356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.242110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.264665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 210/434] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:39.264665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.343557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d0b1-4c90-4055-b18c-2a99eb8de8c4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.379255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.379860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.380139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.380266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934500-2a55-453d-8f87-c45d37d9ec12 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.380445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.381097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:39.381399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.383294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.391480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 225/435] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.392277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.413696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.424098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.425363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.425363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.425538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.426153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:39.426472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.427894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.440508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 211/436] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.440508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.469520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.502552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e179-8224-44dc-9a06-ac93a0c24040 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.537667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f0790-843c-4533-939b-0880cbb7b957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.538826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f0790-843c-4533-939b-0880cbb7b957 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.539093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f0790-843c-4533-939b-0880cbb7b957 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.539369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f0790-843c-4533-939b-0880cbb7b957 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.540852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f0790-843c-4533-939b-0880cbb7b957 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.542015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f0790-843c-4533-939b-0880cbb7b957 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.543676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 226/437] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.545157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f4f07-c941-4816-9657-9d6851202439 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.545157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f4f07-c941-4816-9657-9d6851202439 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.545438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f4f07-c941-4816-9657-9d6851202439 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.550928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 227/438] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:39.550928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f4f07-c941-4816-9657-9d6851202439 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.551199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb02c89-bce2-4703-a20b-03739df7ba31 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.587149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.587765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.588048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.588325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.650800 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.657759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f4f07-c941-4816-9657-9d6851202439 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.664137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.666138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.692681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f2e4-d03d-49aa-95e4-ee4346f741e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.693324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f2e4-d03d-49aa-95e4-ee4346f741e2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.693605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f2e4-d03d-49aa-95e4-ee4346f741e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.693882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f2e4-d03d-49aa-95e4-ee4346f741e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.702650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.766319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7f2e4-d03d-49aa-95e4-ee4346f741e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.767694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7f2e4-d03d-49aa-95e4-ee4346f741e2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.771044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 212/439] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:39.772156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.863467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.872481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 228/440] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:39.873869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.874030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.874305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.876384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37ceb-969c-4df4-a711-ab02d836f1c7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.893124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:39.894326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:39.912153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.912778 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.913117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.913391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.914488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.915930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.917505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 213/441] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.918252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.930313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.967674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 229/442] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:39.968871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.028862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0095-b219-4df9-88fe-97300496d702 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.072153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.072724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.073070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.073325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] PATH_INFO: `/v3/projects/bb857b819d5248abbc3caefd80918b66` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.074574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] RBAC: Authorizing `identity:get_project(project_id=bb857b819d5248abbc3caefd80918b66)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.076053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.083014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 214/443] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/projects/bb857b819d5248abbc3caefd80918b66 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.083014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.087883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d1434-5253-49d2-b86d-33dd3fc677cc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.109526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.126868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.127500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.127782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.128061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] PATH_INFO: `/v3/projects/5b9ee288e46e40168538694a0221a807` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.129353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] RBAC: Authorizing `identity:get_project(project_id=5b9ee288e46e40168538694a0221a807)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.132912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.133092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 230/444] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/projects/5b9ee288e46e40168538694a0221a807 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.133844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.176473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.199153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6db2-b82b-45f6-a619-cae7f34b0af8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.250759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.251759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.252243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.252730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.254102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=30e479ab3dee4ac3aeb96b4eb87bb666, scope.project.id=bb857b819d5248abbc3caefd80918b66) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.254649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.256134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30091-6587-44c2-a1c2-54b81739d4fe None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.257482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.268281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 215/445] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=30e479ab3dee4ac3aeb96b4eb87bb666 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.269883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.300922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.301825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.302244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.302677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.304383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.305923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.307659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 231/446] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.308539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.434297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.454662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9f262-fe19-4f82-b891-55b6a22a89c6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.468442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3d864-7cdd-44c3-b1ff-715ffe6c27af None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.472225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.499093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.499828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.500134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.500414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] PATH_INFO: `/v3/groups/7c6dda1d59c84420990ae6758c440564` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.501597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] RBAC: Authorizing `identity:get_group(group_id=7c6dda1d59c84420990ae6758c440564)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.503199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.505020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 216/447] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/groups/7c6dda1d59c84420990ae6758c440564 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.505957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.518640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.519346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.519654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.519984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.531980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:40.541454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:40.543278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 232/448] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:40.544596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.651877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce74f44-35ed-4f64-9d5b-ed880ea96e31 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.677002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ddf6-51cc-4296-af4a-af0a726c6e5d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.688497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.689143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.689426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.689701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.690434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=bb857b819d5248abbc3caefd80918b66) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.690740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.692181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.700153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 217/449] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=bb857b819d5248abbc3caefd80918b66&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.701055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.723684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.724399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.724780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.724975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.725744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] RBAC: Adding query filter params (group.id=7c6dda1d59c84420990ae6758c440564, role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=5b9ee288e46e40168538694a0221a807) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.726051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.727569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.732187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.738526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 233/450] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/role_assignments?group.id=7c6dda1d59c84420990ae6758c440564&scope.project.id=5b9ee288e46e40168538694a0221a807&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.846971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cc1a-25f4-4009-86f6-928cbe9d7eb0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.894342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.895307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.895817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.896276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.897131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.897583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.899131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.909279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 218/451] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.916280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.964041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.055491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c634bb-5b6a-465e-b704-c2aa9d44a06d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.096465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.097139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.097358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.097631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.188750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.190244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.221897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.317641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 234/452] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:41.324294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:41.428144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.450119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ab68-ac04-4c2b-85c6-b79e9c7e9d2c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.492979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.493735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.494170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.494565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] PATH_INFO: `/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.496781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] RBAC: Authorizing `identity:get_project(project_id=c50ebd1d38a64d4a92701ba8958dbdd4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.498149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.499854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 219/453] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:41 2022] GET /identity/v3/projects/c50ebd1d38a64d4a92701ba8958dbdd4 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:41.505934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:41.617157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b3dc-e7f7-4ad1-aacf-7a576cb6f3d2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.645053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.654222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ea8e3-c8b1-4d19-bb8d-7d0ff9ca5b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.654222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea8e3-c8b1-4d19-bb8d-7d0ff9ca5b5a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.658429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea8e3-c8b1-4d19-bb8d-7d0ff9ca5b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.658429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea8e3-c8b1-4d19-bb8d-7d0ff9ca5b5a None admin] PATH_INFO: `/v3/groups/f6eb4231588b421aa692d8ef81adcb84` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.658429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ea8e3-c8b1-4d19-bb8d-7d0ff9ca5b5a None admin] RBAC: Authorizing `identity:get_group(group_id=f6eb4231588b421aa692d8ef81adcb84)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.658429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ea8e3-c8b1-4d19-bb8d-7d0ff9ca5b5a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.659578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 235/454] 10.222.0.76 () {56 vars in 1180 bytes} [Wed Aug 31 19:07:41 2022] GET /identity/v3/groups/f6eb4231588b421aa692d8ef81adcb84 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:41.666123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:41.774316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8518-093c-49f8-8de1-725d110f4c77 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.809021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.809627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.809903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.810175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.810898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] RBAC: Adding query filter params (group.id=f6eb4231588b421aa692d8ef81adcb84, role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=c50ebd1d38a64d4a92701ba8958dbdd4) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:41.811201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.812627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d177d-5b96-4e1e-aac0-8def3d7a4556 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.818312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 220/455] 10.222.0.76 () {56 vars in 1376 bytes} [Wed Aug 31 19:07:41 2022] GET /identity/v3/role_assignments?group.id=f6eb4231588b421aa692d8ef81adcb84&scope.project.id=c50ebd1d38a64d4a92701ba8958dbdd4&role.id=a3733baec72d443ab044f15928e9f85d => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:44.490057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36c4ef-052c-4154-8103-ebfeffa528ce None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.490580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36c4ef-052c-4154-8103-ebfeffa528ce None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.490580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36c4ef-052c-4154-8103-ebfeffa528ce None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.492476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 236/456] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:44.511570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7013-1318-498a-aa7b-e98be79a75cc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.512507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7013-1318-498a-aa7b-e98be79a75cc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.513014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7013-1318-498a-aa7b-e98be79a75cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.540184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c97e7013-1318-498a-aa7b-e98be79a75cc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:44.541795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c97e7013-1318-498a-aa7b-e98be79a75cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:44.563662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da85f0-92f4-40c6-81c1-3e6d5a68dcc0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.564186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da85f0-92f4-40c6-81c1-3e6d5a68dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.564609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da85f0-92f4-40c6-81c1-3e6d5a68dcc0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.566155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:44.566441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 237/457] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:44.572218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41bc8c-c3e2-470f-88c5-2e8a5d13813d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.572511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41bc8c-c3e2-470f-88c5-2e8a5d13813d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.572779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41bc8c-c3e2-470f-88c5-2e8a5d13813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.626893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-aa41bc8c-c3e2-470f-88c5-2e8a5d13813d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:44.628104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aa41bc8c-c3e2-470f-88c5-2e8a5d13813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:44.673639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 221/458] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:44.748099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 238/459] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:44.840263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1be4-d9d1-4eb6-b407-d80b6971a198 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.840760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1be4-d9d1-4eb6-b407-d80b6971a198 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.841125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1be4-d9d1-4eb6-b407-d80b6971a198 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.842845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 222/460] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:44.848019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.848338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.848590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.877377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:44.878780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:44.991767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1be4-d9d1-4eb6-b407-d80b6971a198 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.004482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 239/461] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:45.127904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.147029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1be4-d9d1-4eb6-b407-d80b6971a198 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.225864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.226535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.226814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.227090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.247713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.249265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.265278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.268030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:45.283215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:45.285264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:45.286409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:45.286409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:45.286409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:45.286409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 223/462] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:45.295740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.350281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a67a-624a-4bae-8825-2c969e8f2ce3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.388845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.389846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.390366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.390778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.403032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.404726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:45.422374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:45.423424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:45.424321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:45.424321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:45.424321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:45.426335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 240/463] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:45.427324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.435214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28274d2-a12f-457d-8141-cfdcc3188dd2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.474448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.475211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.475500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.475777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.476482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:45.476792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.478366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.497022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 224/464] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:45.498059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.561538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322677-9888-4b74-b158-9e0b5ac6c7d0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.568846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.573207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.599158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.599960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.600923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.601438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.613808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965059a2-2634-48bc-a282-7f3788e97d22 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.614285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.616515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:45.636847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:45.640716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:45.642986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:45.642986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:45.642986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:45.642986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 241/465] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:45.642986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.654265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.655034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.655318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.655594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.656297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:45.656607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.658096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.672112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 225/466] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:45.673025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.768402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c8b3-97dd-4563-8f59-656cfdc06e73 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.804843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161306a8-ea9a-47fe-be8f-1ef0c9aec461 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.822911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7978642-63be-4071-8243-1050a7418c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.823889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7978642-63be-4071-8243-1050a7418c45 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.824174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7978642-63be-4071-8243-1050a7418c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.824448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7978642-63be-4071-8243-1050a7418c45 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.825052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.825306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7978642-63be-4071-8243-1050a7418c45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.827073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7978642-63be-4071-8243-1050a7418c45 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.846773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.847514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.847928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.848300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.849092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:45.849525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.851021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.863200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 226/467] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:45.864099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.975201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1f80-8753-4217-aff0-fb3bc22dfbcb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:46.010332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 242/468] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:45 2022] POST /identity/v3/users => generated 246 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:46.011824 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3439-bf6d-4660-a569-286c4424e27e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.012252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3439-bf6d-4660-a569-286c4424e27e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.012548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3439-bf6d-4660-a569-286c4424e27e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.014028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 243/469] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:46.014628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae3439-bf6d-4660-a569-286c4424e27e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:46.026061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c793-44c6-4b9f-bb24-e25710203d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:46.027051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c793-44c6-4b9f-bb24-e25710203d41 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.028063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c793-44c6-4b9f-bb24-e25710203d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.028531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c793-44c6-4b9f-bb24-e25710203d41 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.029831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485c793-44c6-4b9f-bb24-e25710203d41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:46.032905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485c793-44c6-4b9f-bb24-e25710203d41 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:46.057275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:46.145862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae3439-bf6d-4660-a569-286c4424e27e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:46.184918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 227/470] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:45 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:46.185773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe20b0-0afa-4e20-9142-16bb8cc04b3e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.186093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe20b0-0afa-4e20-9142-16bb8cc04b3e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.186376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe20b0-0afa-4e20-9142-16bb8cc04b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.209138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:46.211931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.213877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.214324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.216887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:46.221182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:46.221320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c8fe20b0-0afa-4e20-9142-16bb8cc04b3e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:46.221409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c8fe20b0-0afa-4e20-9142-16bb8cc04b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:46.261567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:46.317383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 228/471] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:46.318869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3e94-94b1-434d-aa40-77cd00eb2bf5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.319793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3e94-94b1-434d-aa40-77cd00eb2bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.320090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3e94-94b1-434d-aa40-77cd00eb2bf5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.321961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 229/472] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:46.327658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.328183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.328464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.346566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 244/473] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:46 2022] POST /identity/v3/users => generated 248 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:46.348590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:46.350291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:46.446857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 230/474] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:46.650749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:46.730868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:46.763358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5b394-b067-4c31-b12f-3b9af2436346 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:46.771259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:46.811006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:46.812126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.812527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.812852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.825894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:46.827468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:46.843610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:46.844564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:46.845459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:46.845459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:46.845459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:46.845459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 245/475] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:46.851552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:46.970242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:46.980329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62840-a34b-4dbd-a7f4-c6dc4784be98 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.005830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a740661-ff87-47c2-b4e7-439771151a37 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.024316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.024961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.025241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.025511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.026184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.027567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.047652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.059017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.059685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.059963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.060235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.060973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:47.061277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.062889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.076539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 246/476] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:47.078686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.sql.core [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:07:47.078686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 19:07:47.078686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [parameters: {'id': '7a7116cb0643488c83b8d26fb929a7f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 19:07:47.078686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81650) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:07:47.089614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result.read() Aug 31 19:07:47.104377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:07:47.105312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application yield resource Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise self.value Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application session.commit() Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:07:47.106202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:07:47.107068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:07:47.107907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result.read() Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:07:47.108707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [parameters: {'id': '7a7116cb0643488c83b8d26fb929a7f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:47.111312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 19:07:47.113290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:47.117677 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 231/477] 10.222.0.76 () {60 vars in 1131 bytes} [Wed Aug 31 19:07:46 2022] POST /identity/v3/roles => generated 144 bytes in 347 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:47.125360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.282650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dea38-433d-4b36-aed4-cd52b9eb8749 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.325085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7819-0d23-4546-8f80-e8cbbc803891 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.338882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.339534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.339810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.340073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.359786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:47.364783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:47.366261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:47.367331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 232/478] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:47.377686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.424465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.435509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9e526-e7cb-443e-9fd8-635e882a5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.436277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9e526-e7cb-443e-9fd8-635e882a5d8c None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.436647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9e526-e7cb-443e-9fd8-635e882a5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.437125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9e526-e7cb-443e-9fd8-635e882a5d8c None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.438480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9e526-e7cb-443e-9fd8-635e882a5d8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.439203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9e526-e7cb-443e-9fd8-635e882a5d8c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.556911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e184d0-385f-43e4-b5a2-570bd35c3e40 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.587469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 247/479] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:47 2022] POST /identity/v3/users => generated 249 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:47.612564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.613222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.613533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.613810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.614657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:47.614972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.616730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb08d8-f368-40db-aadc-33ebf9105fb9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.632050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 233/480] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:48.833552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b4e1-228e-43a4-a619-0a95e91e83d2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.834640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b4e1-228e-43a4-a619-0a95e91e83d2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.835175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b4e1-228e-43a4-a619-0a95e91e83d2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.837114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 248/481] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:48.842342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaff91-30c8-4bf3-89ae-6bbc4325f49d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.843211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaff91-30c8-4bf3-89ae-6bbc4325f49d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.843701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaff91-30c8-4bf3-89ae-6bbc4325f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.868158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-23eaff91-30c8-4bf3-89ae-6bbc4325f49d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:48.869753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-23eaff91-30c8-4bf3-89ae-6bbc4325f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:48.955911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 234/482] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:49.076344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e9cc-5d94-478a-907e-93492f5204d0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.077226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e9cc-5d94-478a-907e-93492f5204d0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.077738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e9cc-5d94-478a-907e-93492f5204d0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.079623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 249/483] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:49.086096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb7f2-11ec-4973-a652-f3de57cdb2ec None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.086636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb7f2-11ec-4973-a652-f3de57cdb2ec None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.087119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb7f2-11ec-4973-a652-f3de57cdb2ec None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.088864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 250/484] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:49.089482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.090092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.090594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.093735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.094248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.094753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.126125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:49.128019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:49.134174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:49.136760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:49.144704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.194285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.264326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 251/485] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:49.270053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 235/486] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:49.289598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.391785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8fee-ffa2-4d4e-aa32-f76507c24772 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.428724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.429805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.430090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.430368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.441114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:49.446482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:49.447417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:49.448283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 252/487] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:49.454021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.556794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.612050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ec91c-9806-4327-85c0-cf0c1b3314da None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.612614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.676492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.677058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.677335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.677610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.678817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:49.679119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.680523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.692347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.704833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 236/488] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:49.712098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.734880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2647ac-c7c6-46cd-8693-8007602ada78 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.779959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.781043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.781650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.782466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.798178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:49.805441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:49.806383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:49.807169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:49.809744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 253/489] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:49.810801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.848012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91090acc-fb95-4d86-9330-0ec76afa4532 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.894184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.894981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.895494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.895843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.910801 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:49.918971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:49.920020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:49.920855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:49.924943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 237/490] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:49.926126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.943390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.957760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e23a1-dd0f-4c31-aec0-45f562bbdb32 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.004003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.005557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.006034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.007293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.013199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.021027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.023283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:50.046360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:50.054396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:50.055232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:50.055232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.055232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:50.055232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 254/491] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:50.055232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.060550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f0d4d-ea0d-4f43-993b-03fac80c6e5a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.104859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.105263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.105535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.105876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.106558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:50.106867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.108260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.124426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 238/492] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:50.126144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.180586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d4c9e-fe57-4fb6-a1f9-84807d75ce5f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.217543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.218076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.218382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.218774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.219710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:50.220024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.221750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6315f52-390d-4cfd-b46a-24883ca7e91a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.231551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 255/493] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:50.232903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f317ae-99cd-4dfb-85cf-018e4e9248a4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.233198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f317ae-99cd-4dfb-85cf-018e4e9248a4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.233476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f317ae-99cd-4dfb-85cf-018e4e9248a4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.237487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 256/494] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:50.238641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f317ae-99cd-4dfb-85cf-018e4e9248a4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.242412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.249830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d6ebc-beae-429c-af7f-afd96d0a2346 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.273975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.288426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.289073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.289345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.289619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.290301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:50.290662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.292056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.303633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 239/495] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:50.304445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.348245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f317ae-99cd-4dfb-85cf-018e4e9248a4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.389001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.389638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.389922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.390197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.402377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.403855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.415104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea63f9e-a302-40eb-b5c3-5d236632456e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5aa8cee0-4de9-47ae-b4bc-c7fa5bddec8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:50.419184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:50.420273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:50.421448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:50.421448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.421448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:50.421448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 257/496] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:50.421448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747f461-1742-4ee3-9850-c6e4190c4a86 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.422059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747f461-1742-4ee3-9850-c6e4190c4a86 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.422059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747f461-1742-4ee3-9850-c6e4190c4a86 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.423471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 258/497] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:50.424294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.424586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.428183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.443599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:50.444965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:50.457131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.457772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.458051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.458327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.470349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.471755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:50.488262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:50.489346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:50.490203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:50.490203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.490203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:50.490203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 240/498] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:50.490203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.502399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.520101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 259/499] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:50.522596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.535242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.628123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38411-9f75-49de-8685-06c227dbe88e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.658809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ece0-cdc9-4d7d-8cc3-3632e0b00ccf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.679524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.680466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.680931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.681933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.692616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.694815 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.701225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.702153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.703076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.703573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.704543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:50.705096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.707523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-fc079ac6-810a-4dda-b5c8-fd2c9156b103 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:50.711213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:50.712243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:07:50.713676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:50.717194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 241/500] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:50.718605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.718920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.719242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.722363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 260/501] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:50.722982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.745375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:50.747057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:50.782488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.824933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 242/502] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:50.825886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.845141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22ba46-4caa-4088-9133-0eef794e2b6b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.861265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.898235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.898870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.899301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.899907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.900914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:50.901229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.903238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.926262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 261/503] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:50.926262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.953710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ff514-be2b-4e18-bbca-bb5783dbee4f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.999071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.999607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.999890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.000172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.000952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.001271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.002734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.047976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 243/504] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.048926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.058138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606501b-e24d-48b7-8762-c62dcf00766e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.067671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.101159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.102142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.102418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.102686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.111123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.112683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:51.127913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:51.129002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 262/505] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:51.130331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.149965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.170206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc5bfa-afbd-406d-ac7b-f0520fa446d4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.210413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.211148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.211489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.211897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.222450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:51.227902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:51.228962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 244/506] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:51.230321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.251099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96c47-59ce-4d68-9489-639e7629a132 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.287836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.288498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.288884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.289163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.297148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.298935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:51.310636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:51.311694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:51.312573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 263/507] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:51.313223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.343343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.343608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2e4a-e9cd-495b-a22a-e3e71ea419ae None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.385717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.386507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.386786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.387059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.400772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.422229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97043-0096-4bec-aa62-d7836122497e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.457389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.457607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.458019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.458298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.458576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.459137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.470433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.471899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:51.486150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:51.487092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:51.489217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:51.489217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:51.489217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:51.489217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 264/508] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:51.493018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.585930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.590291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 245/509] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:51.591303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.612725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06dc34-49e1-49d6-a830-bc71fca71a8a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.639296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.652944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.653607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.653889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.654161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.654897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.655199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.656675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.695039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 265/510] 10.222.0.76 () {56 vars in 1137 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.695892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.704232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59ace-9a53-4863-9eed-1d69fbc67377 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.742765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.743459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.743861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.744176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.745016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.745471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.747056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.755861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 246/511] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.757324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.802617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824e4e-c2a6-4745-a43e-71e9f6304645 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.838067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.838694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.838971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.839243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.839980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.840290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.841803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.845341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.861759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 266/512] 10.222.0.76 () {56 vars in 1137 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.862739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.877162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999008-0774-4f27-bf26-d4baa192232d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.880002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.925375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.926001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.926289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.926544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.927195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.927502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.929576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.942384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 247/513] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.943231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.974086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2e72-69bc-45e2-87d5-7d4de28b77ff None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.011258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.011903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.012191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.012469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.022957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.024442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:52.041056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:52.042856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:52.044550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:52.044550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.044550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:52.044550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 267/514] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:52.044550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.060365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04611-e3bd-42f9-90cc-e81794b10273 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.095037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.097982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.097982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.097982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.097982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.135015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.152000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526efa4-6d18-465d-b35a-2d85d82619e5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.174185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.175683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.188021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.188895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.189179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.189455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.200422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.201959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:52.216763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:52.217920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:52.218820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:52.218820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.218820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:52.218820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 268/515] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:52.218820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.294796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 248/516] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:52.295621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.323339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.327181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdb8c0-a084-4960-bf72-aa9d5edccf96 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.359939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.361666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.362304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.362611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.362903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.401041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590c5c-17d6-41f3-978f-d9ccb1ffb576 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.437202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.439674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.439674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.439674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.439975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.440067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.440390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.440480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.536181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.544920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 269/517] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:52.544920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.553231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 249/518] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:52 2022] POST /identity/v3/users => generated 247 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:52.555233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.662387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b6576-6fc3-4237-bc5e-48def675fdd5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.698651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896336-4f15-4f97-8ed1-ca4418f77fd2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.706475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.707110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.707391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.707667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.708321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:52.708629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.710611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.722928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 270/519] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:52.723784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.735258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.752548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.753173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.753458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.754531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.754531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:52.754737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.756634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.772485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 250/520] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:52.774337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.801235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.863686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce4302-7de1-419e-a536-f4337e58925b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.891283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09900b-7f27-4638-b9b0-3682aa9265de None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.907291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.908048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.908331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.908722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.920402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.921833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.931887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.932795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.933244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.933669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:52.937321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:52.938199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:52.939010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:52.939010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.939010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:52.943173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 271/521] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:52.944114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.951290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.953416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:52.970030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:52.971016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:52.971897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:52.971897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:52.971897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:52.971897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 251/522] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:52.972129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.011298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.072099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e358d5-30b1-4818-84b5-99c240a8f4a2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.087308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f85f0-922b-48d0-bfd6-e7e0031b160d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.096671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.125577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.126267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.126550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.126823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.134189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.135606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.136234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.136787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.137395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.137675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.147393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.148890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:07:53.152482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:53.153515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:53.154331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 272/523] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:53.155355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:53.167061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:53.168854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:07:53.169831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:53.173005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 252/524] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:53.174028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.282586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240ce54-f611-4fea-8e01-892e2874bdf1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.287628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.297810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de7be-179e-42d6-9d30-d9a3929cc803 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.322569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.323188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.323510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.323786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.324478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:53.324734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.326140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.336872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.337483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.338205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.338486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.339134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:53.339440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.340999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.341140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 273/525] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.345909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.354610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 253/526] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.355461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.386733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.466039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcfb8e-d94d-47fb-b225-24de93e7fb9e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.481832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79decbc-77b6-44d5-87d0-be29ad2801b5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.504886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.505773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.506720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.507202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.508212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:53.508673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.510244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.520212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.520914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.521199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.521504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.523415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:53.523415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.525263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.537515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 274/527] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.537515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.549447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 254/528] 10.222.0.76 () {56 vars in 1139 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.550301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.570006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.661048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.673678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03515473-39d6-47d0-a8ca-1a0d8f58ccfc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.686965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dc6f-86e9-4cc5-ae7c-d97ea03110de None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.726258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.726822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.727107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.727451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.728602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.729280 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.729607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.729826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.735651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.737219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.737602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.739068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:07:53.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:53.752673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:53.754427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:07:53.755459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:53.757608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 255/529] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:53.758839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.762366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 275/530] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:53.762570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.861753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.902218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4235f-b412-43f5-bf63-afd2340b1d11 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.903753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3bef-bc0d-4b35-bb5a-6edad476bfc4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.942781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.943496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.944477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.944878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.945803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=0257d1031cbe49f0b2565286946ec6ee) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:53.946116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.947572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.947861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.948176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.948454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.948725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.961096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 256/531] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/role_assignments?user.id=0257d1031cbe49f0b2565286946ec6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.961096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.976607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.044907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.046552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.080525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d98611-8a26-4598-a23d-6b1b2340d848 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.125481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.126185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.126562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.126957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.127739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.128114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.129777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.131873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.152432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 257/532] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:54.153679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.189157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 276/533] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:54.189157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.245979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.266419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08177bc-484e-4ad9-92da-1d9588d91be1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.301133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bfc7b-607f-4522-a7e9-01040ebadfb2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.314089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.315219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.315708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.316208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.317607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.318142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.320394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.335594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 258/534] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:54.336782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.351031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.351709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.351996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.352420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.353427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=50774a4923ce4027a7c36d9972e53e6f) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.353741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.355629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.366579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 277/535] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/role_assignments?user.id=50774a4923ce4027a7c36d9972e53e6f&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:54.367541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.410029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.465265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bedbc-fa34-4a17-b161-249b89688c78 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.503488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.504478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.504478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.505008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.521659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.524939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.530293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa522c-d82a-49ca-a1b1-cb91aa56653a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.547889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:54.551425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:54.552497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:54.554339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:54.554339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:54.554339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:54.555713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 259/536] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:54.561208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.578367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.579806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.580509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.580966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.582151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=011b9ddf05d14d75aaa67fb395ec7312) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.583053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.584771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94236-9eef-446f-9928-4498450f0e08 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.595041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 278/537] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/role_assignments?user.id=011b9ddf05d14d75aaa67fb395ec7312&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:54.690626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd076f-6a8e-4cda-a361-cce210780283 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.690955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd076f-6a8e-4cda-a361-cce210780283 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.691182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd076f-6a8e-4cda-a361-cce210780283 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.692717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 279/538] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:54.700193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.700936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.701477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.727729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:54.729508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:54.731081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21ec1f-a9bb-43c2-ab52-45189fa634f8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.749103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.833697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.835582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.836187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.836714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.837618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.838129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.839822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.875566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 260/539] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:54.882080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.946909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 280/540] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:55.203831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00856cb6-d002-401b-bc55-b4ef71395052 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.271542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.272327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.272631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.272976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.285753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.288053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:07:55.307763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:55.308654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:55.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 261/541] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:55.315240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.469940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab763a-5d95-4f5e-8dc6-f859389f38c0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.480041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.517519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.518491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.518924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.519342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.520190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.520639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.522878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.535881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 281/542] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.538667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.542457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.647890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.664792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f73a-111d-41dc-ae17-a4d42d5f1471 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.709012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.709744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.710029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.710307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.711049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=6a237c4387a84af784b3c0ca921841f7) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.711362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.712829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.721151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 282/543] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/role_assignments?user.id=6a237c4387a84af784b3c0ca921841f7&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:55.842773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430e67-ebec-440d-ae22-8e3ffc99027e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.896599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.897362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.897721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.897916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.911194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:55.917355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:55.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:55.919746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 262/544] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:55.927922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.977022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.035548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d52bd-76e4-4d39-a5c1-893f21a789f3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.071659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.072285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.072827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.073218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.074001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:56.074413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.075898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.086463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 283/545] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:56.093948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.211497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.231061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98074f0d-9930-468a-9839-52a175f609cb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.285571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.286224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.286512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.286792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.300424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.301948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b923e812-f2bf-456e-a070-d8a81ba25133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:56.323094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:56.324007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:56.325903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:56.325903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:56.325903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:56.325903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 263/546] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:56.330672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.465217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.475572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52b32b-c1c6-45c2-a91f-91e24b6b98e3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.553571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.554520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.554940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.555375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.556340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:56.556838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.559879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f5566-fc26-45f8-8b70-65a319b4c376 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.560297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f5566-fc26-45f8-8b70-65a319b4c376 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.560722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f5566-fc26-45f8-8b70-65a319b4c376 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.562980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 264/547] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:56.564428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.570841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.571145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.571434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.584761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 284/548] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:56.590439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.616150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:56.617927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:56.795929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bc82a-67d7-4ca7-aba8-a25c754470fb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.807019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 265/549] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:56.852111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.853054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.853474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.853880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.865865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.868169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7ff17a55-623b-4625-8a4a-852b5d677f45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:56.889060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:56.890031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:56.891211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 285/550] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:56.898356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.966387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44e749-12b3-4033-aee0-589243e676c7 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.966991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44e749-12b3-4033-aee0-589243e676c7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.967579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44e749-12b3-4033-aee0-589243e676c7 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.970480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 286/551] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:56.976455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.977044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.977578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.999001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.012386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:57.013645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:57.032830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.033591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c667d-ccbc-4377-bd65-891c9004df8c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.090997 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:57.091741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.092024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.092300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.093167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:57.093478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:57.095024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b28961-6fa4-4500-8f98-6028603e47a5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:57.104237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 287/552] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:57.124730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 266/553] 10.222.0.76 () {56 vars in 1135 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:57.131577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.326618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0eead-a16c-49d2-8999-0eea8e3493ad None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.332331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393a51c-3009-4941-bcb9-f8d8885ecdfc None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.338212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393a51c-3009-4941-bcb9-f8d8885ecdfc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.338784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393a51c-3009-4941-bcb9-f8d8885ecdfc None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.340387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 267/554] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:57.351211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.351762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.352260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.374516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:57.375167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.375628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.375979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.394533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.396096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:57.397475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:57.461175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:57.462652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:57.485480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 268/555] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:57.486627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.554549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.601616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3fd7-871e-48ea-908c-2dbe8bb45b56 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.643019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 288/556] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:57.643668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:57.644377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.644651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.644769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.645154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.657380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:57.662698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:57.663700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:57.664659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 269/557] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:57.665425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.711242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.782909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed8e6-8d8e-41f4-afe7-89d8caff8942 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.792340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3bfa8-c3f4-4500-9421-4a19aa58da63 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.810428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.823099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:57.823744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.824029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.825314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.836548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:57.843370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:57.847242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:57.847893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.848177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.848456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:57.872661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:57.874406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:57.875261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:57.875261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:57.875261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:57.875467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:57.875542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 270/558] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:57.875542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:57.875661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:57.878016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 289/559] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:57.880061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.990881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184b4e1-bae7-44fd-9e36-b44637266a87 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.993535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.999482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e84b93-6cdd-4c0a-8217-06895200c288 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.032030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.033248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.033534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.033809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.045342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.045586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:58.045960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.046231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.046508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.047309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.047503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.048940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:58.050552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.051567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:58.052548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 290/560] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.054823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.066608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 271/561] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.066608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.100960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.165986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d339f-2bee-4eb9-9c26-ec1bb428b0f3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.200407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.201048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.201327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.201601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.202253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.202848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.204232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.216020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 291/562] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.216833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.245272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.257258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf51a67-08fc-4101-8f30-a2490e58eaf6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.292262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.292908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.293197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.293475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.294136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.294443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.295835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.304917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 272/563] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.305751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.329790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7ba3f-547f-4de2-aa29-3e6d44f4c46f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.370187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.371043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.371457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.371852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.372733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.373224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.374667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf8e5-7544-40fb-885f-6658671cf6ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.383097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 292/564] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.384564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092700-6e83-4de4-a567-6179f5d1db8e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.384929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092700-6e83-4de4-a567-6179f5d1db8e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.385212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092700-6e83-4de4-a567-6179f5d1db8e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.389211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 293/565] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:58.389211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092700-6e83-4de4-a567-6179f5d1db8e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.411273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.420749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee70f-6f47-4e11-9348-a3fa678f11f5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.456354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.457013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.457296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.457564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.469582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.471114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.485849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:58.487658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.488759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:58.489646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:58.489646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:58.489646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:58.489646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 273/566] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.489646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.506956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092700-6e83-4de4-a567-6179f5d1db8e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.546855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.547498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.547778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.548051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.555769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.557408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:07:58.568905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.570056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:58.570931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 294/567] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.571486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.598488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63050be2-0748-4d4b-b4ce-129e7844eeaa None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.633552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.634187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.634473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.634810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.645889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.648076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.650777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9c25e7b0-1d5f-45f5-a4bf-16eb2121c2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:58.663254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.694196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 274/568] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.695332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.695817 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff60d2-06b5-4e0f-bf6d-4fdc96c02141 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.695907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:58.695907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:58.724290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.725459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.725745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.726023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.739995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.741548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.749289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:58.761342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.762483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:58.763379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:58.763379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:58.763379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:58.763379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 295/569] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.763379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.772798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 275/570] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:58.773709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.886392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e933e-088d-4b23-82d9-a3b26a15c242 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.892215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440b03-2bf4-4cf2-a4b4-63312aaf22a2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.922504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.930601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.931215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.931493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.931765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.932408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.932708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.933194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.933845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.934103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.934250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.938603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.938603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.938603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.938603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.953392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 296/571] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.953392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.958406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 276/572] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.960932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.026421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.075478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cc33-8ec1-4960-8368-e929f456ec12 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.082981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48a8f0-ac7b-4089-a7d1-6c5b23caff73 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.114516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.115155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.116106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.116413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.117105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.117415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.118793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.119182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.119799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.120082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.120358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.121030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.121347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.122724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.131728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 297/573] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.132512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.136393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 277/574] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.137309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.215748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.283387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952cb2-ec3d-45fe-9b19-1321b0942098 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.292694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027f0e7-c66b-4e92-a6d4-e057e0c5d673 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.301672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.321605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.322490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.322938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.323325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.329232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.329852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.330243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.330408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.331143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=a7266140e48e4588a147704a0b83bb21) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.331453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.331928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.332920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.333412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.338737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 278/575] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/role_assignments?user.id=a7266140e48e4588a147704a0b83bb21&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.339546 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:59.361124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:59.362295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 298/576] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:59.365089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.479230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813705-b8c4-4e2a-bd0f-0b515fd93ffc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.493075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.500520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ceccb-385c-48e7-a131-b49419750816 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.529294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.530278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.530566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.530841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.550117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.550982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:59.551103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.551296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.551550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:59.557905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:59.559236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:59.560242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:59.561064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.562465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.566145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 279/577] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:59.571967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:59.576938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:59.579360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:07:59.581679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:07:59.583259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 299/578] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:59.584124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.644547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.707846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b0f8-ca3d-4b7e-b0fa-22b2128ae952 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.718055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491075-f0c0-443b-a69a-e61c82e8bbd0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.751929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.753023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.753452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.754028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.764679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.765363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.765644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.765917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.766655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.767044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.767365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.768489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.769933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.793950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 300/579] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.793950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:59.794249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:59.795437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 280/580] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:59.796630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.832487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.920952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.922971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7144-cfa9-4b0e-ae09-8de9e192e78c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.929780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d1974-021a-42dc-b2b2-e8e44e36e37f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.961617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.962371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.962732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.963101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.964037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.964426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.966074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.980052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.980766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.981148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.981491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.982252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.982607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.984044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.991073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 281/581] 10.222.0.76 () {56 vars in 1137 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.991073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.994475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 301/582] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.994475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.122064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.135597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf577a47-7466-409b-9b81-00f474b9fcfe None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.138523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70439-a9ac-4e67-9ff5-b0216d555c88 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.178789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.179445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.179726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.180083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.184564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.185244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.185659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.186093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.187192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:00.187532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.188946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.193629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.195089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.212702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 302/583] 10.222.0.76 () {56 vars in 1137 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.212702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:00.221321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:00.223134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:00.224860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:00.224860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.224860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:00.224860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 282/584] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:00.225246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.238593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.355777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161ca9-bd92-43b1-af39-56d0f767d933 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.358627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a18e6-4fdb-4df9-b4a9-54f8b45ad770 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.398212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.398418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.399025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.399317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.399522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.399630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.400026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.400603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.410433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.411669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.414079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.414878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.417793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:00.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:00.430121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:00.432210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:00.432210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.432210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:00.432210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 283/585] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:00.432210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:00.444237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:00.445287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:00.446165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:00.446165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.446165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:00.446165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 303/586] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:00.446165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.548109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.582438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c7a2-96b2-4c4a-aac6-25b1529dd286 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.603785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eb706-431f-44c2-ab4e-06b19de2463e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.649565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.651050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.651737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.652415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.654354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.654969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.655258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.655532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.656263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:00.656569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.658009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.667366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.668930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.681680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 304/587] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.681680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:00.690180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:00.691180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:00.692524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:00.692524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.692524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:00.692524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 284/588] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:00.698436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.773762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.815306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dd953-e8bf-4743-939a-7bccfac99467 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.845501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067808f-35dc-4869-b9db-a95a598249ac None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.846057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.856958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.857603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.857932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.859836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.859836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:00.859836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.860694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.873887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 305/589] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.877103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.896278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.897281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.897707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.898169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.899137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:00.899718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.901334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.922888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 285/590] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.922888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.005257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d4ad-df14-48f3-98ec-458f49458ce9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.038600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb882f-77fd-43bc-a267-affcef2ae56e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.042775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.050553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.051201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.051479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.052124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.059983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.061407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:01.075464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:01.076629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:01.077998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:01.081706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 306/591] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:01.082818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.084055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.084694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.085008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.085276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.085933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:01.086233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.087619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.113046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 286/592] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:01.113046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.159324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.218865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26139-9b1a-42f4-98e8-512bf02745ac None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.235226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df6e1b-db40-4606-9a45-4ee8dfc224bf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.263053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.263996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.264277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.264553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.272880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.274392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.277146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.277859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.278207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.278558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.286958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.288986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:01.289356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:01.290426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:01.291572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:01.293796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 307/593] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:01.294953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:01.301709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:01.302888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:01.303937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 287/594] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:01.304418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.342427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.417347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397ff7-5972-4d93-a8ac-8c4e44a9ed37 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.428319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.428832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd271e24-31d2-4d22-a722-664e717d6b86 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.455183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.455985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.456284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.456563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.457335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:01.457666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.459725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.468030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.468680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.468989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.469266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.474368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 308/595] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:01.475830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.481526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.483063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:01.495381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:01.496524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 288/596] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:01.497467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.605307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.609899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e13cd-4dfb-4c48-a889-3d7eef275902 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.622981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad3ce0-1ff1-413d-9cff-88ab349043f7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.648364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.649154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.649617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.650005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.650834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:01.651234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.652874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa0053-b88a-4893-adc8-8d27379574c8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.662464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.663185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.663543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.663892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.664663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:01.665075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.666613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.671040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 309/597] 10.222.0.76 () {56 vars in 1139 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:01.672279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e74b6-783d-437c-a7c4-fa4a5fef8d4f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.672568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e74b6-783d-437c-a7c4-fa4a5fef8d4f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.673150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e74b6-783d-437c-a7c4-fa4a5fef8d4f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.674855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 310/598] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:01.675165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e74b6-783d-437c-a7c4-fa4a5fef8d4f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.686735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 289/599] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:01.686735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.707326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.784730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e74b6-783d-437c-a7c4-fa4a5fef8d4f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.786490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8170be9-06d0-422b-aafc-0c8ec5b8c716 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.821341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6bffc-6705-4cfc-b570-8a69692ed106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.822002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bffc-6705-4cfc-b570-8a69692ed106 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.822280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bffc-6705-4cfc-b570-8a69692ed106 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.822551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bffc-6705-4cfc-b570-8a69692ed106 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/0257d1031cbe49f0b2565286946ec6ee/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.823500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.824670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.828056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.828056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.828056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:01.828414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.829878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.841804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6bffc-6705-4cfc-b570-8a69692ed106 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=0257d1031cbe49f0b2565286946ec6ee, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.843298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6bffc-6705-4cfc-b570-8a69692ed106 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.844628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 290/600] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:01.845393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.850351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.940419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 311/601] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:01 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/0257d1031cbe49f0b2565286946ec6ee/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:01.941419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.941704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.941977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.961488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:01.961759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f77d-ebf9-43e4-a29f-40537b3350cd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.962851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:02.003355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.004008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.004288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.004557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.016162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.017725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:02.033823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:02.035032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:02.036148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:02.036148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:02.036148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:02.041013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 291/602] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:02.041674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.060866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 312/603] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:02.060866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.070723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.112365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.168342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbab16-3737-4e87-84c8-bdd2db81511e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.205069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af8c7d-4f19-4ef3-a0f3-a5f008193099 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.210715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.211387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.211667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.211942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/011b9ddf05d14d75aaa67fb395ec7312/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.228321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=011b9ddf05d14d75aaa67fb395ec7312, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.229822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.247799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.248462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.248742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.249047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/50774a4923ce4027a7c36d9972e53e6f/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.270296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=50774a4923ce4027a7c36d9972e53e6f, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.270296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.331344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 292/604] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:02 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/011b9ddf05d14d75aaa67fb395ec7312/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:02.332190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.364378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 313/605] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:02 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/50774a4923ce4027a7c36d9972e53e6f/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:02.369702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.496024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776131-97d7-4013-80bf-f7dd000ed9c8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.514161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.518726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.544706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.547237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.547425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.547903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.548638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:02.548994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.551388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.564770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 293/606] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:02.570747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.598495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21ccb-57d2-4b5e-a241-ea4e848c1cfd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.646010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.647759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.648042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.648355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.659811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:02.665386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:02.669067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:02.670056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 314/607] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:02.672581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.701213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9335766-ada6-46dc-8c8d-69675c3f345a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.738374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.739010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.739300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.739572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.747153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.748574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:02.762936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:02.769932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 294/608] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:02.772165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.783582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4102-11b3-40cb-90f4-0fc2971abff4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.801774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.804426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.846997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.848013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.848546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.849178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.850570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:02.851088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.852688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.872720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 315/609] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:02.877785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.880246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a381f-64d9-432b-89c3-94b18238da8f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.919600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.920219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.920501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.920773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.921527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:02.921836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.924827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.943632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 295/610] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:02.944995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.050231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.057489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66ba4-8a84-43d4-8471-3332edb853d1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.096099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.096773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.097342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.097623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/6a237c4387a84af784b3c0ca921841f7/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.114866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c9eba-cee2-4f5b-b2a4-344f3544fd55 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.117872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=6a237c4387a84af784b3c0ca921841f7, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.118488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.172694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.173518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.173870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.174209 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.191174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.193525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:03.211830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:03.212988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:03.214056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:03.214056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:03.214056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:03.214056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 316/611] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:03.222773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.243176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 296/612] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:02 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/6a237c4387a84af784b3c0ca921841f7/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:03.282801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.386118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095aa285-0b35-43f5-aa7c-514312e5ef3d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.434161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.434840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.435129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.435409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.436070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:03.436381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.437805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.458658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 317/613] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.464796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.611540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ecea-b4ea-478a-ba80-6455b40ca8ed None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.665624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.666199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.666554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.666836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.673925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.680228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.681833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:03.702960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:03.705303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:03.706900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 297/614] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:03.712181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.842893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.853938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757f542-9781-46cf-a842-8bc69005d08a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.901016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.901639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.901986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.902264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.903063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:03.903377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.904844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.924050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 318/615] 10.222.0.76 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.930495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.071896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0237bf-43a3-46bb-a823-e74b5649ec15 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.116631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.117307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.117593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.117872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.133412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.134877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:04.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:04.153740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:04.155623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:04.155623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:04.155623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:04.155623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 298/616] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:04.159342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.294714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809341ac-1cf9-415f-9fbb-44af56affc5e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.347973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.349025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.350043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.350516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.351388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.351889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.353487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a38dc5-bc20-493d-809c-0713a236fb12 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.370371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 319/617] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.376337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.473215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.488345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26623050-930d-4aa5-8642-741fa15a7b2b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.489089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26623050-930d-4aa5-8642-741fa15a7b2b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.489569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26623050-930d-4aa5-8642-741fa15a7b2b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.492040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 320/618] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:04.518515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d8981-13ab-477f-bdaa-2ab1b0baf437 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.519234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d8981-13ab-477f-bdaa-2ab1b0baf437 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.519748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d8981-13ab-477f-bdaa-2ab1b0baf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.553975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c265dd4-4616-4aa9-a4c8-8a8ffd1a6ca7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.575469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1b1d8981-13ab-477f-bdaa-2ab1b0baf437 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:04.577959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1b1d8981-13ab-477f-bdaa-2ab1b0baf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:04.581745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.638767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.640032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.640528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.641068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.649656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.651495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-857a6960-68c7-4ac9-b89b-dd1a3969cd70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:04.664668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:04.665813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:04.667396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 299/619] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:04.668261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce115-e26e-4776-b2e6-c1cc476c6e41 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.668261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce115-e26e-4776-b2e6-c1cc476c6e41 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.668261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce115-e26e-4776-b2e6-c1cc476c6e41 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.672879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 300/620] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:04.672879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce115-e26e-4776-b2e6-c1cc476c6e41 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.747495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 321/621] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:04.747495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.747495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.747495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.766897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:04.768135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:04.859156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce115-e26e-4776-b2e6-c1cc476c6e41 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.883693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.916898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 322/622] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:04.923031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.923656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.923992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.924270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.925031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.925583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.928269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.945594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 301/623] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.953920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.034238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.065224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.070263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0084-2bd3-428c-9ae8-77f993fcf2d6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.108140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e3680-3a14-41bb-9656-01d343fff334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.108845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3680-3a14-41bb-9656-01d343fff334 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.109125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3680-3a14-41bb-9656-01d343fff334 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.109456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3680-3a14-41bb-9656-01d343fff334 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/a7266140e48e4588a147704a0b83bb21/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.129848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e3680-3a14-41bb-9656-01d343fff334 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=a7266140e48e4588a147704a0b83bb21, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.134716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e3680-3a14-41bb-9656-01d343fff334 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.191692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1afb7-fd41-40ea-8df8-e3ee0c0d904a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.232959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.233613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.233895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.234203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.251153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:05.261744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:05.263509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:05.266547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 302/624] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:05.272990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.307199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.329158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 323/625] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:04 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/a7266140e48e4588a147704a0b83bb21/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:05.330607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295739-6c48-4566-8707-6b86af81cb19 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.330903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295739-6c48-4566-8707-6b86af81cb19 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.331184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295739-6c48-4566-8707-6b86af81cb19 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.332654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 324/626] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:05.333473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295739-6c48-4566-8707-6b86af81cb19 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.410078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d77099-1e83-4b0f-af56-630de2a766de None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.452915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.453607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.453939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.454226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.454977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.455289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.456845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0df65-87ae-4cbe-85cd-dfb646cf9c70 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.466605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 303/627] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.468096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.468397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.468674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.477071 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295739-6c48-4566-8707-6b86af81cb19 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.488346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:05.489720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:05.505607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.518882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.519885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.520234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.520600 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.537426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:05.542688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:05.543830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:05.544883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:05.550673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 325/628] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:05.550673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.604952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 304/629] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:05.606019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.634789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.673260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d1707-1cb3-4a59-bbf4-1135263292ce None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.720277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.726243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.726243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.726243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.745528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.747029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:05.776664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:05.778132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:05.779018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:05.779018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:05.779018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:05.779018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 326/630] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:05.786008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.788580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a8cf-308f-473d-8bdd-7fdc36321d97 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.842116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.842738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.843027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.843304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.843981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.844290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.845723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.855281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 305/631] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.857825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.860315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.950442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.951992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e84b4-d036-4447-a7fe-bd675c9274c6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.970909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b80137-04a5-4e76-9e30-9355fb141cb4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.989024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.990766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.991379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.991789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.992466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.992766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.994146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0131971-2af2-4cdf-a517-665ed0f2444c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.008852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 327/632] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:06.008852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce146-5fdc-4b5c-b214-367a9cdddfe7 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.008852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce146-5fdc-4b5c-b214-367a9cdddfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.008852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce146-5fdc-4b5c-b214-367a9cdddfe7 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.010989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.011899 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.012326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.012793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.014037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 328/633] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:06.014863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce146-5fdc-4b5c-b214-367a9cdddfe7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.025646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.027356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:06.043051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.044247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:06.045343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:06.045343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:06.045343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:06.047323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 306/634] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:06.048435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.140711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.156296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce146-5fdc-4b5c-b214-367a9cdddfe7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.176679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f25d-4d8b-4685-bd9f-806ca6e43a62 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.196116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9f707-fd68-4382-a9f0-8a0317af785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.196752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f707-fd68-4382-a9f0-8a0317af785b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.197064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f707-fd68-4382-a9f0-8a0317af785b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.197341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f707-fd68-4382-a9f0-8a0317af785b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.214678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9f707-fd68-4382-a9f0-8a0317af785b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b1b9f707-fd68-4382-a9f0-8a0317af785b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:06.222061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.222983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:06.223843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 329/635] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:06.225237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.225351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.225553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.229365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.230120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.230462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.230662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.232940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.242543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.244067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.247608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:06.248901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:06.256367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.257361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 307/636] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:06.258285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.336858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 330/637] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:06.336858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.437359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889575df-c7a9-4629-b891-b6798b69a74c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.477344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.478794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.479420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.479766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.480041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.480701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:06.481038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.482435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.496486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 308/638] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:06.497877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.506323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f2d8-74a3-4662-b74a-751a521ef212 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.558628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.559264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.559551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.559853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.560369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.560580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:06.560857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.562352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.577646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 331/639] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:06.578617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.628244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de534a-c865-4b83-a166-086c940995ca None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.671436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.672053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.672338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.672615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.673425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:06.673733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.675180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.693807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 309/640] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:06.694685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.715044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8313c-a5ba-42fb-b376-bf82d2feeac4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.754916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.755453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.755748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.756067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.764716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.767091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:06.785492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.787517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 332/641] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:06.790087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.792849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.823250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa2af-ab5a-4e80-8268-e81c73a33f80 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.847925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.876138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.877544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.878018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.878301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.889443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.890906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:06.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.908755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:06.909700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:06.909700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:06.909700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:06.913581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 310/642] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:06.914489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.925287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef0438-bef7-4def-b364-8ab7521024ac None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.969079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.970063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.970351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.970644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.985670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:06.991095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.992026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:06.992975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:06.996994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 333/643] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:06.997856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.033864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e20fe0-6f80-4af8-b016-a36f8f25f29b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.063304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.071039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.071656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.071941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.072459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.108032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f64914-58c7-4188-ba4b-8a2cfe23ca3b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.115895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.158532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.159401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.159825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.160229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.161287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:07.161795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.163837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.165418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.166861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.186124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 334/644] 10.222.0.76 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:07.186726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.279779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 311/645] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:07.280635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.307010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bfa4c-0c84-47fc-91a5-e503a7819664 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.331887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.348598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.349749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.350052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.350413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.351052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:07.351360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.352747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.354334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.369162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 335/646] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:07.369162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.404520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a0746-f861-48bd-bdde-c6e8231dc9f0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.440975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.441742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.442024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.442298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.443142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:07.443451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.444883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.453325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 312/647] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:07.454133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.483389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1184-769c-4bf8-a0d3-d43f65b3e4b5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.516509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57ea17-01ff-480f-aeb1-e58ada926357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.517104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57ea17-01ff-480f-aeb1-e58ada926357 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.517393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57ea17-01ff-480f-aeb1-e58ada926357 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.517777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57ea17-01ff-480f-aeb1-e58ada926357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.563969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4da8b-703e-46e8-9226-0ee0ae4a6898 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.569176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.589039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57ea17-01ff-480f-aeb1-e58ada926357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.590223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.590826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57ea17-01ff-480f-aeb1-e58ada926357 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.598676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.599416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.600218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.600496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.611049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.612531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:07.627445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:07.628539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:07.629465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:07.629465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:07.629465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:07.629465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 313/648] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:07.629913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.705769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 336/649] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:07.707045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce10c1-0d30-429c-a60c-09b0facc3a96 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.707337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce10c1-0d30-429c-a60c-09b0facc3a96 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.707617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce10c1-0d30-429c-a60c-09b0facc3a96 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.708956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 337/650] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:07.709676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce10c1-0d30-429c-a60c-09b0facc3a96 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.739408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae2bf9-f560-458f-8908-334e242b62f1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.777912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.778551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.778838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.779117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.787477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.789249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:07.801826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:07.803556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 314/651] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:07.804474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.812040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.832271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce10c1-0d30-429c-a60c-09b0facc3a96 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.844180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.868446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.869208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.869467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.869785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.880433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.881974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:07.897286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:07.898383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:07.899432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:07.899432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:07.899432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:07.899432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 338/652] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:07.899432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.914050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3b308-d526-4e56-a700-e23add44686d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.948694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.949363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.949643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.950080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.950847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:07.951149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.952855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d4cb-4803-4c1f-9f63-293077eaf2f7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.965333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 315/653] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:07.966508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.966788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.967056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.985127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:07.986388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:08.002002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788373c8-83b7-4440-bb50-0b09b7fe2ec4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.032413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.038225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.038940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.039247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.039522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.050157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.051671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.054712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 316/654] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:08.055619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:08.079617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.081671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:08.082678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:08.082678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:08.082678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:08.085744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 339/655] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.086616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.092832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.176131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc963586-3a3d-400e-8ab4-5f097e31427b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.204539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473605-5e02-4178-8de6-f9f8ddcba4b6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.224971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.225703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.225990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.226265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.227005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.227316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.228756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.240936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.241542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.241820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.242092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.242725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.243036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.244401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.246713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 317/656] 10.222.0.76 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.247530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.261109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 340/657] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.261930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.310218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.344132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.359069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30824c-2734-4119-b6e6-c5f03a4e6e32 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.374047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820ca57-cbba-400b-afb2-fc894d8f3d00 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.397983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.399076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.399409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.399819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.407361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.408905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.414048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.415216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.415216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.415216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.415926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.416132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.417540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:08.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.421784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:08.422693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 318/658] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.423704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.432620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 341/659] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.433509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.526309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc132b3-2998-427f-95f8-de3a90569ee6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.545636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533361-7533-4356-abe7-b52ec3bd9f3b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.553781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.574003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.574887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.575330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.575675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.586251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.587134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.587548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.587884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.594532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.597711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.600006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:08.611750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.612720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:08.613690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 342/660] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.614296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.658768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.660260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.735837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec060-cbac-44b6-93f8-9983a223a737 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.772027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 319/661] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:08.773327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.782235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.782900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.783183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.783537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.797250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:08.803251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.804281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 343/662] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.805541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.833347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.835583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.889638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693fc42-19af-430a-9fd0-80016168ad0a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.914883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38abf42-01e9-41d9-827a-2373e6f62d71 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.924936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.925547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.925828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.926099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.926793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.927103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.928711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.940222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 320/663] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.940963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.947030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.947654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.947931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.948197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.955235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.956692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:08.968330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.969251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:08.970126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 344/664] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.970594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.047970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff44da-5a4a-412c-bcfc-cf0c55afe615 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.055212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.070995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0aa6a-cfd9-4a6d-8372-b1655a5b2824 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.082761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.083368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.083693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.083994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.084754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.085092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.086521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.103335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 321/665] 10.222.0.76 () {56 vars in 1139 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.103636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.104144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.104247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.104616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.104949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.108488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.118203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.119652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:09.133650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:09.134647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:09.135511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:09.135511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:09.135511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:09.137078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 345/666] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:09.137772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.206575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce16c-7974-427a-87b4-d0e33cf523d3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.247025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.248543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.248543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.248543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.248881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.248971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fb2d6-b7cd-49d3-a1d0-0ab8326e34a6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.249143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.250524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.259564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 322/667] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.260520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.292087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.292701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.293014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.293293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.294038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=0257d1031cbe49f0b2565286946ec6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.294336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.295766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.299233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.304518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.305151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 346/668] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/role_assignments?user.id=0257d1031cbe49f0b2565286946ec6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.305970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.402795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842c887-8c6c-4a33-aaa7-db703a5d1a4a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.444366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.445046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.445333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.445610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.445708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629e149-2056-4b45-ae97-a1b2a341c759 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.446324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.446630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.448100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.466543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 323/669] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.467576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.491045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.492036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.492036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.492191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.572270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.574645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.576142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.581076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.596769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb650-1fed-4cd5-8234-497df252b088 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.634369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.634984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.635289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.635545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.636203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.636512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.637942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.662134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 324/670] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.662134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.732485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 347/671] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:09.733415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.799896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abcc05-6dd3-4acb-9e07-e085ee16aac3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.836881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.837523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.837806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.838092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.851218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.853121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.855747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.860085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e3d59-d973-4c4c-8348-dbe4c22ea6c6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.864077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:09.874062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:09.875602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:09.877264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:09.877264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:09.877264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:09.877264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 325/672] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:09.877264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.905960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.906580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.906861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.907184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.907923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=011b9ddf05d14d75aaa67fb395ec7312) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.908234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.909721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.924445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 348/673] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/role_assignments?user.id=011b9ddf05d14d75aaa67fb395ec7312&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.925550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.023913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614b05-6ba9-4797-a9a4-abd98e4356b5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.075723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769d52-04d6-469e-8416-585a0636f405 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.084666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.085360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.085697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.085970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.093261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.094814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:10.107905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:10.109147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 326/674] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:10.110250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.125032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.125577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.132258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.132258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.137745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.139313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:10.159460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:10.160516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:10.161625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:10.161625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:10.161625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:10.162312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 349/675] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:10.167369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.184683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.187664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.239168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328f82a-179c-4c18-9125-417caf8d23fc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.277877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.278830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.279319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.279800 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.280674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.281210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.282811 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.296904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 327/676] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.298309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.299554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b41eeb-aa5b-49f1-afd2-fc333c49f821 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.347898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.348655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.348976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.349876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.350584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.350889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.352579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.371810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 350/677] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.372753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.414135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37ee14-85f8-47a1-a633-1f8964f94299 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.434388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.453819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.454785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.455271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.455774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.457206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.457726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.459524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.461641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.477948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 328/678] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.640137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.640858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb155c-0813-427c-9741-b323028fc4fb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.640858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.640858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.640858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:10.641185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:10.641840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:10.642709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:10.643652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:10.643652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 351/679] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:10.643652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.643919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6bcc0-6581-462d-abda-565e46ba01a5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.647388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.647388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.647388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.647388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.652824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=50774a4923ce4027a7c36d9972e53e6f) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.652824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.652824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.657196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 329/680] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/role_assignments?user.id=50774a4923ce4027a7c36d9972e53e6f&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.658136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.707745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d130-c4ed-488b-ad5d-cc0dbeb12a63 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.759387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.799697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.801479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.801775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.802055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.809067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.818375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.819897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:10.842351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:10.844579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:10.846716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 352/681] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:10.851022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.874739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12b72-c161-421d-a4bd-5dcb3eca1e2a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.915975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.916513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.916911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.917194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.917938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.918247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.919751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.940125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 330/682] 10.222.0.76 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.948330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.999326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4fbb-ec51-49d6-8ad4-c9a2f509d4fa None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.039818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.040726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.041129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.041473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.042304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:11.042642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.044081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.064067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 353/683] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:11.070789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.085113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.088057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707dc0e-6297-4074-9d8a-444318682ea2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.129227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53c0d-02aa-4036-afc8-74e1ca833918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.129957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53c0d-02aa-4036-afc8-74e1ca833918 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.130241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53c0d-02aa-4036-afc8-74e1ca833918 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.130626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53c0d-02aa-4036-afc8-74e1ca833918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.135518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.182685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a1247-179c-48f7-9b22-fbbcc98d95b3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.206606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53c0d-02aa-4036-afc8-74e1ca833918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.208088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53c0d-02aa-4036-afc8-74e1ca833918 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.225128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.225949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.226232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.226795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.227539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=6a237c4387a84af784b3c0ca921841f7) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:11.227854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.229746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.238025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 354/684] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/role_assignments?user.id=6a237c4387a84af784b3c0ca921841f7&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:11.321272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.325641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 331/685] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:08:11.331662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.491581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9590763-46fb-4aee-b67d-1ba034163f91 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.512746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.527529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f26b-2013-4e50-918f-b74d7b123707 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.527977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f26b-2013-4e50-918f-b74d7b123707 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.528371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f26b-2013-4e50-918f-b74d7b123707 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.529547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.530100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 332/686] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:11.530277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.530590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.530869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.535921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.536201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.536480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.543761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.545272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:11.566076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:11.567078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:11.568006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:11.568006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:11.568006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:11.568006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 355/687] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:11.570629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:11.572080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:11.572901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.664467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 333/688] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:11.696354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d2bf8-27e4-487d-9f8c-eb739572ecd7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.734487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.735107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.735392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.735665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.736319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:11.736624 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.738058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.753094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 356/689] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:11.758749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.891104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdc380-c1aa-48f8-bd29-ae8cc17f7bee None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.931100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.938002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.938654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.939014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.939291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.949143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.950943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:11.977367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:11.978317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:11.979179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:11.982044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 334/690] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:11.990171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.025737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.102410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.112942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c48a-8437-4060-92c9-2113620d5f84 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.156429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.157114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.157400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.157700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.158405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.158724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.160279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.173467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 357/691] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.179253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.221215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911563e-e217-4619-aeea-a3586ca29443 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.263731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192f3c-3650-4920-8d26-2f3166f83482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.264370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192f3c-3650-4920-8d26-2f3166f83482 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.264654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192f3c-3650-4920-8d26-2f3166f83482 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.264971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192f3c-3650-4920-8d26-2f3166f83482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.280089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6192f3c-3650-4920-8d26-2f3166f83482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f6192f3c-3650-4920-8d26-2f3166f83482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:12.287351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:12.288449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:12.289488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 335/692] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:12.290635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff0989-f12f-4424-b4ed-6c5d516e901c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.290740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff0989-f12f-4424-b4ed-6c5d516e901c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.290952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff0989-f12f-4424-b4ed-6c5d516e901c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.296868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 336/693] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:12.296868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff0989-f12f-4424-b4ed-6c5d516e901c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.321264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.330406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6995a-e784-4ace-a8dd-74409a0c766d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.356044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.367124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.367757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.368083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.368367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.369140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=a7266140e48e4588a147704a0b83bb21) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.369522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.371018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26142f3-cb1f-4070-bbcd-8cc35de16502 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.384527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 358/694] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/role_assignments?user.id=a7266140e48e4588a147704a0b83bb21&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.386052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.386346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.386627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.420007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:12.420608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff0989-f12f-4424-b4ed-6c5d516e901c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.421296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:12.462148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.463188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.463681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.464163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.465233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.465766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.467396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.478552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 337/695] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.485869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.567395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 359/696] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:12.668418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc528f-3d71-44f6-925d-ac64a5962f36 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.692098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.722041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.723634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.724301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.724587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.736264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.737776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:12.755492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:12.756518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:12.758112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:12.758112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:12.758112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:12.758112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 338/697] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:12.762907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.871836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.888731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6ee3-bf6a-4040-a7e6-e344d8db3f7a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.927104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.928326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.928621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.928980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.929647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.929999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.931403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.944374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 360/698] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.949517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.966851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.102413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773a0bf-93ce-4267-8da3-90aa97e44c91 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.133889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7d0d-6c72-4ad6-8b4d-ecd3a27043c8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.186410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.187560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.188060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.190189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.207126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.210881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.212708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.213656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.214140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.214787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:13.236656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.237723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:13.238684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:13.243060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.244696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 339/699] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:13.246741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.254126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.261403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7280e9d9-446c-4c11-9a1d-e41fa956582c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:13.272935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.274326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:13.275210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:13.275210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:13.275210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:13.275210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 361/700] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:13.275430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c7f6-1d85-44cb-8cfd-50a947336aae None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.275818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c7f6-1d85-44cb-8cfd-50a947336aae None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.275925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c7f6-1d85-44cb-8cfd-50a947336aae None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.277519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 362/701] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:13.287549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.288131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.288664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.300320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.319296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:13.322889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:13.396490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1c6ef-502b-4f99-8a32-1cfc8657ceed None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.407106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 363/702] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:13.408315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.489594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.490854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.491203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.491547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.492422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.492730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.494287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.533828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 340/703] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.550893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.565937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44ae85-733d-4d29-94db-756e6c510e1b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.628203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.641929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.642549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.642828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.644608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.644608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.644608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.645516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.675440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 364/704] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.681920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.689198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.707712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94bf01-487e-4c4e-8d6f-ec89568b8edd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.750539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.751153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.751430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.751703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.837077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.839041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.851753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158263a-bba0-469c-b8b7-8ee0fade7254 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.890137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c19117-c0ed-49f5-bb0e-4bfe629496bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.890925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19117-c0ed-49f5-bb0e-4bfe629496bf None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.891327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19117-c0ed-49f5-bb0e-4bfe629496bf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.891676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19117-c0ed-49f5-bb0e-4bfe629496bf None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.892406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c19117-c0ed-49f5-bb0e-4bfe629496bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.894250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c19117-c0ed-49f5-bb0e-4bfe629496bf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.941124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.960833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 341/705] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:08:13.961678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.009528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 365/706] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:13 2022] POST /identity/v3/users => generated 254 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:08:14.009528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b556a7-01c4-4e6b-a7d3-2fb3a8412cd0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.009528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b556a7-01c4-4e6b-a7d3-2fb3a8412cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.009528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b556a7-01c4-4e6b-a7d3-2fb3a8412cd0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.009528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 366/707] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:14.016578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b556a7-01c4-4e6b-a7d3-2fb3a8412cd0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.089442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.119615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267828f-bc13-48ac-8c64-0610b3eba13c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.159953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b556a7-01c4-4e6b-a7d3-2fb3a8412cd0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.179686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.180330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.180614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.181109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.181687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.184472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a4a26780-9675-4930-98be-9f2ed1e7660e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:14.199123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:14.200432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:14.201424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 342/708] 10.222.0.76 () {56 vars in 1129 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:14.202842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.203150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.203502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.213057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.214819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.215290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.215742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.226456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:14.227674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:14.229459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.230944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:14.247195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:14.248235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:14.249183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:14.249183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:14.249183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:14.249183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 367/709] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:14.249803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.289577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.343452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 343/710] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:14.344855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.376211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.383255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feea80-40d9-489f-9205-790d73664dba None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.420874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.421849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.422273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.422692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.423500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.423945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.425491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.431572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 368/711] 10.222.0.76 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.437010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.565769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c213a-65cc-4174-93ba-d47ef36b3946 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.566790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd26c-e1a8-40fa-853b-f26d85a66914 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.606472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.607370 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.607818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.608231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.609250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.609719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.611536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.620420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 369/712] 10.222.0.76 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:14.635696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.636362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.636646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.636952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.637618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.637922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.639314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.654171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 344/713] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.660197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.678368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.697762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.750804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.797768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384944c1-4571-4d91-997a-25d3470d6223 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.837267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.838292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.838801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.839274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.849746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.851740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.856171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ecaf-ba04-46dc-88d6-972da96b4abf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:14.865466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:14.866836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:14.868229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 370/714] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:14.876992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.920067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.920861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.921154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.921424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] PATH_INFO: `/v3/services/network` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.922334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.924481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:14.936729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:14.938612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:14.939591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 345/715] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:14.946970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.991911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:15.015829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064924dc-2e07-4206-9e57-cbaf1dce74d5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:15.061876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:15.062740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.063285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.064220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.065702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:15.066172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:15.068203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd18cb-a8dc-44ae-b544-18237d486b85 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:15.081246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:15.084713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fda6d6-5c18-4d21-aeb9-57c6956e01be None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:15.084957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 371/716] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:15.086394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508c97-ef41-4624-b3ac-291fca99e430 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.086834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508c97-ef41-4624-b3ac-291fca99e430 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.087430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508c97-ef41-4624-b3ac-291fca99e430 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.089155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 372/717] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:15.091902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508c97-ef41-4624-b3ac-291fca99e430 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:15.140138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:15.140757 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.141087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.141367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.142011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] RBAC: Adding query filter params (name=network) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:15.142321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:15.143718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe9b1-bac5-4eb4-afd4-fc7383c62673 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:15.154365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 346/718] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:15.154365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.154365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.154365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.172368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:15.173892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:15.224999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508c97-ef41-4624-b3ac-291fca99e430 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:15.269100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 347/719] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:15.269100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:15.270705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:15.271437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.271710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.271987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.272731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=0257d1031cbe49f0b2565286946ec6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:15.273106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:15.274557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:15.288837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 373/720] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:15 2022] GET /identity/v3/role_assignments?user.id=0257d1031cbe49f0b2565286946ec6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:15.387953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:15.395543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd5d03-840b-4296-924a-dff5f4c2ebe2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:15.433564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:15.434385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.434762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.435137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.435887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] RBAC: Adding query filter params (type=network) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:15.436787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:15.438981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:15.446341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 348/721] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:15.629006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:15.647282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:15.744659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b213f0-dfd8-42c1-b075-97a81ec9bd9a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:15.781034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:15.781678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.781962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.782249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.793080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:15.798394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:15.800626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:15.803361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 374/722] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:15.809146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:15.934324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9540e-228e-41d5-87f1-e2244ccb9c27 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:15.983620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:15.984491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:15.984994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:15.985421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:15.986593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:15.987049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:15.988753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:15.998082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 349/723] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:16.003844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:16.077811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:16.113750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adae0fc-e1cd-41ce-8be9-3c35cca90a68 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:16.167473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:16.168163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.168456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.168732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.179799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:16.181283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:16.200988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:16.202554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:16.203656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:16.203656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:16.203656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:16.203656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 375/724] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:16.210380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:16.262791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:16.360269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a03d2-092b-427a-9675-9d00d33f7bed None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:16.401631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:16.402273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.402556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.402834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.403496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:16.403819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:16.405310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2220e-0590-4828-9ed5-7b5cb8ed9697 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:16.418587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 350/725] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:16.426684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:16.564546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d7bb3-4917-4962-b10b-94d2f2b55734 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:16.600956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:16.612395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2804-8821-478d-b59a-9e697463f42c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.612749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2804-8821-478d-b59a-9e697463f42c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.613070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2804-8821-478d-b59a-9e697463f42c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.619643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 351/726] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:16.620235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.620529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.620824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.622478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:16.623117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.623396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.623666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.637921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:16.639368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:16.640267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:16.641588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:16.656194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:16.657210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:16.658135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 376/727] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:16.666321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:16.798825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 352/728] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:16.847669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168d9b-470d-432e-a4b2-d1173571d310 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:16.902735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:16.903352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.903660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.903944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.904777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:16.905115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:16.906537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:16.934646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 377/729] 10.222.0.76 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:16.940729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:16.962299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.081227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.131083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ac4c3-aae8-4e4a-bbd1-06623b9a69b1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.145212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.212257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773a7c-30d7-4319-a0ce-39b7267b68fe None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.230920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917a71e-3515-4d43-bc3e-d99c59918c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.231822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917a71e-3515-4d43-bc3e-d99c59918c75 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.232309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917a71e-3515-4d43-bc3e-d99c59918c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.235204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917a71e-3515-4d43-bc3e-d99c59918c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.277262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.277907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.278229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.278514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.303831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:17.309412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:17.311189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:17.312953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:17.322153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 378/730] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:17.330143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.367721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917a71e-3515-4d43-bc3e-d99c59918c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.370481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917a71e-3515-4d43-bc3e-d99c59918c75 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.384182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.482622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 353/731] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:17.484061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb56d5-fa22-40f6-a9cd-bf14e9d6918c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.484355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb56d5-fa22-40f6-a9cd-bf14e9d6918c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.484732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb56d5-fa22-40f6-a9cd-bf14e9d6918c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.486366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 354/732] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:17.489038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb56d5-fa22-40f6-a9cd-bf14e9d6918c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.502264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.507718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dee27-cdfb-48db-a96d-f38b7e8d0fcc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.555324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.555983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.556270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.556547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.557361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:17.557761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.559447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601931e-5dac-444e-a852-e532711abf9b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.576684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 379/733] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:17.578395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.578687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.578967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.598526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:17.600557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:17.614152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb56d5-fa22-40f6-a9cd-bf14e9d6918c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.626595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.658938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.658938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.658938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.658938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.666542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.668177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:17.686191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:17.687446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:17.688579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:17.688579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:17.688579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:17.688579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 355/734] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:17.688579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.704476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 380/735] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:17.706064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.824933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.826433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e766f4-650f-4e52-919e-ae127e5ad27b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.837750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38ea5c-18db-4b65-927d-136e7ccc84a1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.875375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.875625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.876041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.876332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.876612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.877195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.877303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:17.877596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.878008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.878478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.878966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656655e-a9ad-4ca2-b5b1-c71a9b0f1d6f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.891344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 381/736] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:17.893382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.895130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.897883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae4441-ffbd-4e03-a999-766511650822 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.898108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae4441-ffbd-4e03-a999-766511650822 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.898370 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae4441-ffbd-4e03-a999-766511650822 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.899925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 382/737] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:17.900657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae4441-ffbd-4e03-a999-766511650822 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-bbd5da20-be07-4d4e-97f3-e549ff8348cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:17.914917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:17.915922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:17.916847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:17.916847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:17.916847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:17.923149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 356/738] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:17.923149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.923149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.923149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.946761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:17.947996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:17.958945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.030993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 357/739] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:18.031888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.064652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae4441-ffbd-4e03-a999-766511650822 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.103965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.105074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.105514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.106075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.115904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.119501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:18.140080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:18.143979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:18.148656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 383/740] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.149645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.171566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.178539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2401d-4d1e-4860-9162-77e4fa7fddb0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.217239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.217857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.218141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.218434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.219113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.219419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.220833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.234512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 358/741] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.235423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.239378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.262469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390538a-e66d-425e-b0ab-399e77e625fb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.300939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.301901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.302434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.302867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.303970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.306231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.345792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dda3ad-a18f-4ccc-a62a-3b879a63ff13 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.385776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.386505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.386820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.387115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.387838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.388183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.389826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af638c-9b37-4ed7-9357-df4caa08b0de None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.402638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 359/742] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.403798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39c475-3075-4a28-83c1-52f25ba8c458 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.404104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39c475-3075-4a28-83c1-52f25ba8c458 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.404379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39c475-3075-4a28-83c1-52f25ba8c458 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.405599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 360/743] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:18.406386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39c475-3075-4a28-83c1-52f25ba8c458 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.470830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.483155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 384/744] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:18 2022] POST /identity/v3/services => generated 251 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:18.484128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.523846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39c475-3075-4a28-83c1-52f25ba8c458 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.563407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.564075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.564391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.564674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.573407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.574890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.579567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:18.588984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.596505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 361/745] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.597557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.618591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764594-da47-42ba-beb5-93023cf26b73 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.665005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bf575-b3d4-4093-bc2d-73de8edbc80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.666007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf575-b3d4-4093-bc2d-73de8edbc80b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.667099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf575-b3d4-4093-bc2d-73de8edbc80b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.667099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf575-b3d4-4093-bc2d-73de8edbc80b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.679447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bf575-b3d4-4093-bc2d-73de8edbc80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-589bf575-b3d4-4093-bc2d-73de8edbc80b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:18.684950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.686003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 385/746] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.688742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.688742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.707495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:18.708757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:18.721814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960f121-3566-438a-961d-bfbbb8d91b42 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.744384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.761799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.763037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.763037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.763037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.763736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=a7266140e48e4588a147704a0b83bb21) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.764048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.765555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.780832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 362/747] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/role_assignments?user.id=a7266140e48e4588a147704a0b83bb21&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.780832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.805292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 386/748] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:18.807013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.923584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.974868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f53fd-acbc-409c-84e1-89452132cb8e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.978044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551113ca-d6d5-409a-bcee-dd9fd2accf8c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.027842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.029960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.030248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.030527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.032607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.033275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.033555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.033831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.034501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:19.034835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.036230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.038750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:19.039070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.040529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.058865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 387/749] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:19.066996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.072458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 363/750] 10.222.0.76 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:19.089960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.153131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.216615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093d78d-afd1-4d28-acdd-e937d3f4dade None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.235707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82809df0-9025-4d0e-abd3-9c07467761f8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.257185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.258524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.259059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.259553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.261902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.273800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.277826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.277826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.277826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.288309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.289867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:19.305880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:19.306911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:19.307802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:19.307802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:19.307802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:19.307802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 388/751] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:19.308603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.348698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.351159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.406695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.418566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b631e7-fd71-4d51-b61c-3e6b0f5689a5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.455316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.455939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.456220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.456495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.457186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.459205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.472466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 364/752] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:08:19.490049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.556994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 389/753] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:19 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:19.556994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.615975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ba5de-f309-49b1-beab-a306784672da None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.639077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.679061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.680143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.680713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.681330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.682391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:19.683392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.685413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.711395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.716861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 365/754] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:19.724477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.818627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b07dd9-d329-4df4-a569-ae48f7fc3768 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.861525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.862162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.862449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.862719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.875183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.879053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c4f4-1e40-4589-bcf8-44eb1e40cc77 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.879716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:19.908843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:19.909864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:19.910780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:19.910780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:19.910780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:19.911972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 390/755] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:19.919874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.931184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.932107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.932589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.933041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.947266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.949786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:19.973240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:19.974824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:19.976040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 366/756] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:19.982105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.091470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.096893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238198b-6817-40dc-9f5e-a35f1cda0535 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.105220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.139096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.139897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.140191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.140468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.141514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:20.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.144642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.180185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 391/757] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:20.186435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024d2c9-66f2-45d6-bb81-54511ca96b81 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.188264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.282798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.283739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.284031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.284302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.285168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:20.285596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.287788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.312292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c56d-22a5-4b7f-95a9-262f5a790e67 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.324236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 367/758] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:20.330212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.355635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.356335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.356623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.357085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.365698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.367169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:20.380776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:20.381775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:20.383581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 392/759] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:20.388587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.399405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.513250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfa211-35ec-415c-a31c-59bec682eff8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.551236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.551885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.552211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.552496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.552761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740a671-2bb5-4979-8c32-cd8c46436022 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.553258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:20.553571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.560832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.571871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 393/760] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:20.580831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.617267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.634691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.635341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.635791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.636068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.649724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.651859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7d0ac3f5-bf50-4c20-a6ba-a97a9e7c50d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:20.672236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:20.673286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:20.674165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:20.674165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:20.674165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:20.674165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 368/761] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:20.674393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.675292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f6d0-dc22-4f9c-925d-63f0813712d3 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.680490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f6d0-dc22-4f9c-925d-63f0813712d3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.680490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f6d0-dc22-4f9c-925d-63f0813712d3 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.680490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 369/762] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:20.685811 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f6d0-dc22-4f9c-925d-63f0813712d3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.722277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01f53-f2f7-457b-a7de-a432c7cf2d56 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.766603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.767225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.767510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.767791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.768986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=9214312ee30a41e085e9038be016b6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:20.769306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.771214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448e34c-6420-4cfa-ae61-5547ad1cdb63 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.785054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 394/763] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/role_assignments?user.id=9214312ee30a41e085e9038be016b6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:20.787072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0db86-90d6-4d7b-9161-c3636b6b26df None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.787357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0db86-90d6-4d7b-9161-c3636b6b26df None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.787631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0db86-90d6-4d7b-9161-c3636b6b26df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.812385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f6d0-dc22-4f9c-925d-63f0813712d3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.817069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8ef0db86-90d6-4d7b-9161-c3636b6b26df None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:20.818818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8ef0db86-90d6-4d7b-9161-c3636b6b26df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:20.888502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.891323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.891609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.891887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.894263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:20.894587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.897153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.924673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 370/764] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:20.930986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.965961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 395/765] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:20.993537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.030902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f673c8-77c2-4eac-a969-9ff7138fcbc1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.031773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f673c8-77c2-4eac-a969-9ff7138fcbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.032448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f673c8-77c2-4eac-a969-9ff7138fcbc1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.035217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 396/766] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:21.042467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.043044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.043563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.075914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:21.085777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:21.113743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac69bc-7702-4871-95f3-7eabf8edcd23 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.205129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.206004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.206439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.208579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.233407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.235815 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.238553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.253287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 397/767] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:21.260500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:21.261445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:21.262423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:21.262891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 371/768] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:21.268967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.337889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.448371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683cf61-b5ed-471f-b52b-1f41e0223202 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.477378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.492103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532792-2b3b-4147-b28e-2b17c476bc5d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.511179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.511875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.512163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.512439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.513179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:21.513487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.514915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.534206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 398/769] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:21.549861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.579221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.579860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.580144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.580424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.581039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.582415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:21.596998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:21.598180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:21.599949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 372/770] 10.222.0.76 () {56 vars in 1129 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:21.607809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.647359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.698338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f590f9-fb4f-4617-86a1-dab4c0a01b2a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.733402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.734162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.734550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.734928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/0257d1031cbe49f0b2565286946ec6ee/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.736100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc867f8-7db5-457b-9361-90bc94f7e452 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.737108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=0257d1031cbe49f0b2565286946ec6ee, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.738715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.774146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.819439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.819439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.819439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.819439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:21.819439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.819439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.819962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 373/771] 10.222.0.76 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:21.819962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.819962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.885480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102b34-1646-4a19-a6b0-5365445c8c6b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.918305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.918939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.919220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.919495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.930740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 399/772] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:21 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/0257d1031cbe49f0b2565286946ec6ee/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:21.930740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.939603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:21.945557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:21.946520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:21.947402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:21.950316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 374/773] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:21.957320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.041530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455718ca-44c4-4d70-8ab6-6a87f8275bf1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.053271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.057157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.079463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.080273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.080562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.080858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.081894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.082216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.084062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.085442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235f4df-8fd2-4adf-87f5-aa0f1ee18e2d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.091407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 400/774] 10.222.0.76 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.099251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.159282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.160725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.162103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.162586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.164169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.164891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.167234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.179328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 375/775] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:22.188612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.267544 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705baba-8024-457a-96d7-4956dca9ddad None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.312660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.313489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.313767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.314208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.314805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b718686-ea14-4866-a872-fedcd53fd84c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.314917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] RBAC: Adding query filter params (interface=public, service_id=a9a58109e36e4bcd8e3757b04adbb28a, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.315212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.316834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9382-008a-40d2-8305-2446b4cd2e98 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.328819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 401/776] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/endpoints?service_id=a9a58109e36e4bcd8e3757b04adbb28a&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.330066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773be3a-8cc7-4861-8342-2346fe9ed1a9 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.333165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773be3a-8cc7-4861-8342-2346fe9ed1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.333469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773be3a-8cc7-4861-8342-2346fe9ed1a9 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.334845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 402/777] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:22.336607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773be3a-8cc7-4861-8342-2346fe9ed1a9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.362406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.363071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.363319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.363596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.373722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.378050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.380288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.392988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3d9e6727-bc5a-4361-bf30-5b9911876e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:22.401378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.404267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:22.409691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:22.409691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:22.409691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:22.410263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 376/778] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:22.411971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.412455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.412989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.434611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:22.436925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:22.459862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773be3a-8cc7-4861-8342-2346fe9ed1a9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.495772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.496417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.496694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.497004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.497619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.499137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.509395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 403/779] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.509395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.528955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 377/780] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:22.648579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf163-7ad4-4ea3-bce1-40c891e00976 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.650253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.686085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.686711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.687003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.687281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.687932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.688239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.689676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.702964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 404/781] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.709836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.819220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafd9b-61e8-4fb5-ac94-f0182434e0b5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.841117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.860718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.861397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.861701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.862018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.866198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.870281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.871924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:22.885150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.886188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:22.887330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:22.890301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 378/782] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:22.896919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.991215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa276ce1-7beb-4b12-bc2c-e4381eef431d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.017318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd210dbd-eb8c-4ffd-b0d5-50de5e1ab771 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.029884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.030900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.031457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.031929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] PATH_INFO: `/v3/services/network` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.032718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.034312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8da9aeaf-ba35-47a1-b1e6-efe8957b8b23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.046411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.047408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:23.048229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:23.050969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 405/783] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:23.053134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7faf5-b877-4f46-a032-9716930dfb4a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.053735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7faf5-b877-4f46-a032-9716930dfb4a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.054225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7faf5-b877-4f46-a032-9716930dfb4a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.055943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 406/784] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:23.056853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7faf5-b877-4f46-a032-9716930dfb4a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.066994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.067660 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.067945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.068220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.069566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.069883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.071332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386309-aa17-4d74-ad01-44a824af46e8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.092003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 379/785] 10.222.0.76 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.098159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.099185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.099639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.099742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.125457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:23.127089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:23.169184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.196385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7faf5-b877-4f46-a032-9716930dfb4a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.212448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 380/786] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:23.220867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.275433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.276554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.277666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.278570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] RBAC: Adding query filter params (name=network) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.279179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.281006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.295943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 407/787] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.303024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.336021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9ccb-4668-4c35-9903-f2d4df837c3e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.378725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.379735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.379735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.380013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.402910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.404427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:23.422505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.423510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:23.424387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:23.424387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.424387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:23.429101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 381/788] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.431072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.457487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.507069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.518092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797114-25b4-4944-a2c0-2eabe09cfb01 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.571588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.572840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.573756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.574484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.575303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] RBAC: Adding query filter params (type=network) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.575772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.576401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ddd4-6045-4fe9-807a-127f8e47aeec None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.577800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.585740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 408/789] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:23.586855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.626797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.627583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.627998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.628377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.629271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.629678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.631794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.650785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 382/790] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.650785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.716038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7ea0-e854-4799-a353-4aa8408f90cc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.750797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.754332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.755535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.755821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.756098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.769590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:23.775426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.776384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 409/791] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.777878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.781978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4f842-fea1-4a9c-99d9-f50e6d1021e3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.794670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.822094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.823087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.823580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.824065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.825173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] RBAC: Adding query filter params (interface=public, service_id=ed7b712b890f4247b40e3b368b11f3ad, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.825770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.827711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.839166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 383/792] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/endpoints?service_id=ed7b712b890f4247b40e3b368b11f3ad&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.840542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.892560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c4eb-9a41-47f6-b222-a6de892c3761 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.931366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.932021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.932669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.932780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.940318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.941805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.953144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842cd9c-f8ca-4e9e-8147-f9503164d906 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:23.954928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.955837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:23.956737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:23.961646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 410/793] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.962550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.995280 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.996301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.996937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.997521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.998398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.998905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.000610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.010207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 384/794] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.011517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.022617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.047011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.075652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b015-2bc9-450e-891f-f03b0ca59983 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.113966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.114582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.114919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.115204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.115822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.117441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.123672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 411/795] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.124578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.140560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9ff8-a749-4d88-a410-7bbdf78ff16c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.212167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.213234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.213725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.214204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.215217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.215828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.217531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.257365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 385/796] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.271638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.341076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df65d17-08e5-473f-a789-8772ea205a67 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.395177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.405554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.407893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.407893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.407893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.418404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.423277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.424778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.444223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082298f9-eafa-4f20-986b-05e70733b275 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-9eaae198-afde-450c-840d-01fdc3c937b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:24.444798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.445746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:24.446640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:24.446640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:24.446640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:24.446640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 412/797] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:24.447480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fadb87-68a3-4d81-b04d-27e0caf3cf0a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.448836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fadb87-68a3-4d81-b04d-27e0caf3cf0a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.448836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fadb87-68a3-4d81-b04d-27e0caf3cf0a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.455270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 413/798] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:24.456149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fadb87-68a3-4d81-b04d-27e0caf3cf0a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.488767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a75fe-8879-4bf2-a175-fca61ce36734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.489526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a75fe-8879-4bf2-a175-fca61ce36734 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.490024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a75fe-8879-4bf2-a175-fca61ce36734 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.490298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a75fe-8879-4bf2-a175-fca61ce36734 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/a7266140e48e4588a147704a0b83bb21/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.493023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a75fe-8879-4bf2-a175-fca61ce36734 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=a7266140e48e4588a147704a0b83bb21, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.494493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a75fe-8879-4bf2-a175-fca61ce36734 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.571609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fadb87-68a3-4d81-b04d-27e0caf3cf0a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.572617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 386/799] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:24 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/a7266140e48e4588a147704a0b83bb21/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:08:24.580050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bdb9c-f3df-4b03-a598-0f8e30166325 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.580050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bdb9c-f3df-4b03-a598-0f8e30166325 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.580321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bdb9c-f3df-4b03-a598-0f8e30166325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.623464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ce1bdb9c-f3df-4b03-a598-0f8e30166325 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:24.624613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ce1bdb9c-f3df-4b03-a598-0f8e30166325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:24.652913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.654372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.654670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.654945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.655610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.656141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.657589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.686375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 414/800] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.693967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.772013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 387/801] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:24.773821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723860-49f1-4ba1-a4fc-1b345d5d9102 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.774313 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723860-49f1-4ba1-a4fc-1b345d5d9102 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.774808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723860-49f1-4ba1-a4fc-1b345d5d9102 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.776580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 388/802] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:24.778901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.781713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.783342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.783919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.805381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:24.807000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:24.841625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2af8-d874-4106-8bae-9bb5c41b0109 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.881755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.888049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.888049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.888049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.891003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.892561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:24.907820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.908874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:24.909800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 415/803] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:24.916251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.027577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c79ff-08b0-4159-8857-473711336ce2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.034421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.042751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.056485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 389/804] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:25.068935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.069777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.070986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.071259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.071997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.072297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.073762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.077520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.096038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 416/805] 10.222.0.76 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.102397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.191514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b74c4a-a73c-49ce-9fd0-55ff3d8e5e48 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.231921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.233001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.233535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.234053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.238203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d316-0175-4527-80a1-47844b0af960 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.246399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:25.251984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:25.253188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:25.254053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:25.257295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 390/806] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:25.263486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.292191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.293262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.293775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.294249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.314337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.318457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:25.349264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:25.350265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:25.351196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:25.351196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:25.351196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:25.354936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 417/807] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:25.360150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.365903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.417373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.440071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22521-7199-4ce5-855a-d6f0069eef23 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.494043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.495042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.495529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.495988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.496885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.497420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.499161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.515537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 391/808] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.517011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.641818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf117-8986-4f79-a892-fa1849d4377f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.651325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88018bc-fc95-41fe-afb5-d01ee5e847c7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.657103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.695160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.696042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.696467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.696647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.696950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.697223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.697605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.697863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.698164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.698552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.699338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.699517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.701422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:25.713962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:25.715063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:25.715955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:25.717276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 418/809] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.718025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.724480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 392/810] 10.222.0.76 () {56 vars in 1129 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:25.726444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.822092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.844070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b9a7-9722-49d3-a7a2-8c9d8c496846 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.862952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5812124-d358-4f15-a005-58353ee716f9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.887106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.887767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.888060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.888316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.901005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.902908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.908334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.909270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.909779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.910284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.919886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:25.920588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:25.921531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:25.922432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:25.922432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:25.922432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:25.924166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.926528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 419/811] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:25.927567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:25.941166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:25.942090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:25.943506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 393/812] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:25.943987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.990874 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.055601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae225d2-8177-42d0-a4af-1a870dda4733 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.083995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7015e-edbd-4c5f-a33a-b81967eff790 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.096643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.102640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.103546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.104024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.104543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.111879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.111879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.111879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.112765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 420/813] 10.222.0.76 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.113826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.136437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.137137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.137423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.137701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.138356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.138716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.140666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.158498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 394/814] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.159370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.250429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bef0b-a21b-477a-b58d-e5c5f6c8b795 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.263223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.272041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c8d5e-d815-4c83-bd21-b19937ba8fbc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.287521 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.288145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.288433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.288711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.289453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.289765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.291234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.304221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 421/815] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.309631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.314146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.315039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.315554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.316008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.316843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.318035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.320048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2b2f6-0931-4719-a0a3-348b06e7ed00 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.327526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 395/816] 10.222.0.76 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.329401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ffbe-96b5-4b1e-87ec-4d332640da68 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.329883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ffbe-96b5-4b1e-87ec-4d332640da68 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.330321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ffbe-96b5-4b1e-87ec-4d332640da68 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.332470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 396/817] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:26.333702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ffbe-96b5-4b1e-87ec-4d332640da68 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.370016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.416252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969ad3-d015-4aa2-90f8-7e237f163cce None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.448078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ffbe-96b5-4b1e-87ec-4d332640da68 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.452944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.453582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.453865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.454138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.462007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.463513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-762666e8-c405-48aa-937a-1ce25751ceb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:26.475919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.477130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:26.478063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 422/818] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.478724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.478724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.478856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.493150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.493821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.494100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.494377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/9214312ee30a41e085e9038be016b6ee/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.497428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:26.498638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:26.509860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=9214312ee30a41e085e9038be016b6ee, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.511356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.567928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 423/819] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:26.568760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.628922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 397/820] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:26 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/9214312ee30a41e085e9038be016b6ee/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:26.628922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.633716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.648126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.752703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c41bc-840b-403a-a54a-41cac4ce3a5a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.816445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79ea8-232d-48e6-8a43-4b5c90350aa5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.834756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.835402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.835746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.835928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.836620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.838151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.862075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.864875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.864875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.864875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.864875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.865172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.866487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.884891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 398/821] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.885604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.946863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 424/822] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:26.947710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.960030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.019582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3988-af62-43e4-bd91-d45e7adc1027 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.066869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.068013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.068564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.069059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.069934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.071686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-19ff0b8b-bbb6-41a1-abe2-7f1aa344a2b1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:27.082488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:27.084072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:27.084919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:27.086580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2d18-0f47-47e5-a57a-023e66bb7ddc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.088170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 399/823] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:27.089718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778376df-851a-47a7-beda-9a15f7cf26d5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.090001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778376df-851a-47a7-beda-9a15f7cf26d5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.090273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778376df-851a-47a7-beda-9a15f7cf26d5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.091642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 400/824] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:27.095704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.096700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778376df-851a-47a7-beda-9a15f7cf26d5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.139798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.140670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.141725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.141725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.225177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.227193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.233797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778376df-851a-47a7-beda-9a15f7cf26d5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.259749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.278442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.279360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.279639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.279914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.280635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] RBAC: Adding query filter params (name=network) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:27.280967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.282337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb0616-0ce4-4743-a1c0-994977fa4a5a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.288816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 401/825] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:27.290202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.290491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.290771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.309567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:27.310860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:27.366316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 425/826] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:27.367569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.394605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 402/827] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:27.396113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.445200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.480841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c20be5-f121-4eb8-b01e-03aa0c7c5aa6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.519473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.520546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.521059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.521569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.522406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] RBAC: Adding query filter params (type=network) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:27.522911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.524480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.531227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 426/828] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:27.537502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.620418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.663736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c067f6b-4171-47ea-9a86-2573783faebc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.703264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.704396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.704924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.705399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.706099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036bd31-7f72-4a4a-9831-44dfda4a8954 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.706907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.708927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.741589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.761394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.762388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.762872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.763347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.774608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.777783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:27.791927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:27.792944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:27.793827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:27.793827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:27.793827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:27.795541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 403/829] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:27.800386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.809826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 427/830] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:27.818033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.933181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe13fa-eecc-40b3-820b-dee9aef5c6dc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.961195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486216-8353-4bc0-b382-4b646240d7a0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.985928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.003533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.005144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.005647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.007394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.007394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.007394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.009229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.028842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 428/831] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:28.030462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.033624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.034267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.035835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.035835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.048561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:28.054681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:28.055620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:28.056454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:28.060687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 404/832] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:28.062010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.102206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.170969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8229-6232-49aa-b304-ef335aa469ee None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.197704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60081-b34c-42b3-b2a2-ab7e53cddd77 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.211617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.212308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.212586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.212936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.220413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.222010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:28.236439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:28.237422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:28.238296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:28.242876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 429/833] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:28.243798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.245023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.245878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.246360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.247059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.248890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.249433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.251080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.265992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 405/834] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:28.275216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.312390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.393692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eace6-f24e-47a4-b1de-49b1641d39ef None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.399820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.421826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc191-73fe-4177-9e33-0ee5457295f9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.448661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.449270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.449687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.449964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.450670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.451305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.453312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.463474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.464569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.465104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.465585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.476201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 430/835] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:28.477671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.480730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.482449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:28.498803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:28.499799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:28.500678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:28.500678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:28.500678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:28.502853 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 406/836] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:28.510246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.613336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.618282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9e1db-89fa-49d5-89c8-0a5af4ba460d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.656903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.657956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.658524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.659061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.659735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d01fcf-2943-40ea-8b8d-046439ed639b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.660285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=0257d1031cbe49f0b2565286946ec6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.661000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.662889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.670463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 431/837] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/role_assignments?user.id=0257d1031cbe49f0b2565286946ec6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:28.707434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.708976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.709477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.709956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.710890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.711518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.713213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5584e10-6d3a-444c-9266-19404948a942 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.727780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 407/838] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:28.733148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.803678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c360-81d6-4369-a172-12a6febf1d9d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.804018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c360-81d6-4369-a172-12a6febf1d9d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.804227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c360-81d6-4369-a172-12a6febf1d9d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.805887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 408/839] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:28.811690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.812324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.812930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.821228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.833066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:28.834755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:28.855181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e0b8-4244-4cb4-8cdf-39aa1a7348c8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.897880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.898478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.898765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.899041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.908317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.910490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.923856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 409/840] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-029b1075-700e-48e3-b49a-b322a1e1c85e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:28.926649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:28.927573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:28.928587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 432/841] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:28.934327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.051427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d5c3e-6fb3-48d1-9a58-0fb51730b918 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.088671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.089668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.090179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.090656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.091626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.092138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.093891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.095845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.098231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20368ae4-2650-446b-8ff3-52b75bf6decd None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.099226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20368ae4-2650-446b-8ff3-52b75bf6decd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.099326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20368ae4-2650-446b-8ff3-52b75bf6decd None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.100914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 433/842] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:29.106944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.107339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.107728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.117680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 410/843] 10.222.0.76 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:29.124020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.129580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:29.131048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:29.158703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.217945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 434/844] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:29.219822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.238668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98ea1-6126-4471-81b7-588976c80e43 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.291080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.292550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.293098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.293895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.341800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7cef-24fb-4233-a3b1-c48050de1280 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.378996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.383492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.384110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.384489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.384898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.391238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.393328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.395828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:29.401518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.402623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:29.403672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:29.405482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 435/845] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.410532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.430070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.523489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291f61-36ce-4236-9c61-370e7ee3eb18 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.525835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 411/846] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:08:29.526753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.573520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.574153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.574442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.574722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.575395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.575702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.577391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.591437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 436/847] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:29.592603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.632971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.642792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7061c-bc26-4056-b65e-498d7cac8290 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.674760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.679708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.680348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.680638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.681234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.681554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.683400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.692887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.694120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:29.694971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 412/848] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.695786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.707015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950791-ca14-457a-a354-7c7a24956d18 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.743372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.744049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.744338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.744612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.756850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.758306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:29.773814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.774811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:29.775713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:29.775713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.775713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:29.775713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 437/849] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.776372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.818483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776894-3314-4034-94fc-78d72662c0ec None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.856658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.857618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.858046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.858533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.870722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.872399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:29.887379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.888535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:29.889589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:29.889589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.889589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:29.892857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6ed8-5b54-4829-b1a6-d49469966efa None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.896782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 413/850] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.897673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.912034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.922373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.932145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.932761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.933425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.933425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.933954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.934258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.935686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.940530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 438/851] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:29.941449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.026967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be12a1-08cf-4f8b-a7c4-fef2608cc34b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.045698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4a129-54d5-4239-9a68-165bf2a366b2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.063978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.064461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.064740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.065042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.065686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.066100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.068050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.081626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.082238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.082523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.082852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.083511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.083819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.085450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.088081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 414/852] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.089146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.103776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 439/853] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.103776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.154637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.171036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.207925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea05112-f98f-4f4e-bec3-ecff6813e896 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.210123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae2f3b-1585-410a-a2b6-f768cc32b341 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.245191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.245437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.245810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.245936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.246175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.246328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.246328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.246483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.247244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.247552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.248953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.253605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 415/854] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.254412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.257808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.259334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:30.277367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.281208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:30.282322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 440/855] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.284383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.385065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207c99a-0ea3-4e91-bdc8-3e92e5c69707 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.426075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.430393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933be3-7322-48f7-8e2a-aa1f840c6abd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.432291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.433079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.434316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.436122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.454078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.456689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.461901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:30.471126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.472101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:30.473064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 416/856] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.477561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.477933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.478661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.479176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.479648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.480606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.481087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.482625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.495967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 441/857] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.501847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.618454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962c35-2b67-438e-8eb6-e20e3cc3a4e2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.623614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a67643-ee6f-4339-b4e2-c2e3f2c1e65f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.663434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.664610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.665172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.666021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.667312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=a7266140e48e4588a147704a0b83bb21) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.667806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.669662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.670786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.671474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.671834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.672245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.673090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.673473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.674993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11df9ed-dc86-4a6a-ab2b-c64639a86018 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.680619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 442/858] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/role_assignments?user.id=a7266140e48e4588a147704a0b83bb21&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.707089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 417/859] 10.222.0.76 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.713822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.757218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.788424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e7dd3-b562-4a93-8bc3-26702125be4b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.789614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e7dd3-b562-4a93-8bc3-26702125be4b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.789614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e7dd3-b562-4a93-8bc3-26702125be4b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.790721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 418/860] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:30.796332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.796659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.796920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.822246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:30.824943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:30.837651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4acda-0e3d-48b9-a34a-4fcf5142cf3c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.885501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.886067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.886393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.886672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.887729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.916176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 419/861] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:30.974848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.976632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.012464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.080906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 443/862] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:31.086313 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.193459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21eaa-8338-45ec-9a89-3ad6b9379bb3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.202605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.232426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.233194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.233476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.233769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.245042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.246603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:31.263151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.264145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:31.265069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:31.265069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:31.265069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:31.265069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 420/863] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.271694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.313530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.328554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466dc2-3119-454b-9349-473bc7d0673a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.377537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.379031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.379946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.380564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.381819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.385064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.387769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.400013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.401023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:31.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:31.404880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 444/864] 10.222.0.76 () {56 vars in 1132 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.407875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.412015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913efec-f7a4-4271-85fc-21230022590f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.452140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.452948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.453322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.453866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.454622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.455359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.457363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.474025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 421/865] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.482304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.549605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c9bd0-fc14-419f-8077-e1ed016e504b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.595539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.596979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.597445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.598124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.599698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.600147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.600869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.602292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.609696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 445/866] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:31.617066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc60d7-5709-41ae-827a-30e24cad552a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.617276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.658745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.659382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.659707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.659986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.669044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.670500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:31.685004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.685916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:31.686790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:31.688947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 422/867] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.691757 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.698814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.747901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09c6e-a98d-486d-957e-67d09032f947 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.791097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.791751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.792083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.792362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.793368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.793676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.795464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.809171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 446/868] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.824037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6f8e-782b-46ae-80ba-bd103b89a8e5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.866705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.867823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.868353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.868880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.869860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.870443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.872213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1cec2-f798-4d53-99d3-9c0c3d619c25 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.886507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 423/869] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.893024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.012251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c713-d3f7-44f0-bf1e-afe0082a2f68 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.046635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.056384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.057025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.060688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.060688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.060688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=9214312ee30a41e085e9038be016b6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:32.060688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.060688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290cb51-b30f-4fd6-83a0-0c5ac1a131e9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.068272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 447/870] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/role_assignments?user.id=9214312ee30a41e085e9038be016b6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:32.327919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e509-3089-4145-9035-dd36b8ee4878 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.328219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e509-3089-4145-9035-dd36b8ee4878 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.328485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e509-3089-4145-9035-dd36b8ee4878 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.330145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 424/871] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:32.336005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cf6a-c486-4e24-91a3-7e589385505b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.336471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cf6a-c486-4e24-91a3-7e589385505b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.336550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cf6a-c486-4e24-91a3-7e589385505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.356448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-78a6cf6a-c486-4e24-91a3-7e589385505b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:32.357686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-78a6cf6a-c486-4e24-91a3-7e589385505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:32.432151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 448/872] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:32.711862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e509-3089-4145-9035-dd36b8ee4878 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.728440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.759750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db727bd-eda8-4bde-8fe1-7c21991d1c62 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.760150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db727bd-eda8-4bde-8fe1-7c21991d1c62 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.760472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db727bd-eda8-4bde-8fe1-7c21991d1c62 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.762518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 449/873] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:32.769464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.769856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.770224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.793383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:32.795536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:32.831484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e509-3089-4145-9035-dd36b8ee4878 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.883549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.884431 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.884981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.885267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 450/874] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:32.885576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.886242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.887619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.009821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 425/875] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:32 2022] POST /identity/v3/services => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:33.155571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.209506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.260544 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303378c8-433b-485e-8494-fecc34b47f64 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.304710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.305457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.305741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.306012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.306687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.308065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:33.319004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:33.320013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:33.321483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 451/876] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:33.329919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.404101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.436557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b732c0-e658-47f0-baac-85d2c44d9091 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.473083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.474552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.475009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.475579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.476388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:33.476914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.478540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f482-072d-4eef-9877-3482755bac12 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.484201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 426/877] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:33.490952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.602598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20566f-9a5a-422e-9164-431ab9e6d806 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.614488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.639443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.640052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.640333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.640610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.641272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:33.641575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.642936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a658-f2ec-45fc-8e13-e71f257911c4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.648616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 452/878] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:33.872269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb8e8-655e-4162-b8e0-e8015f3caa8e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.873258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb8e8-655e-4162-b8e0-e8015f3caa8e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.873737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb8e8-655e-4162-b8e0-e8015f3caa8e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.875511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 427/879] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:33.880952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b6cae-f2e9-4f03-b7b2-4b04cc8afe87 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.881491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b6cae-f2e9-4f03-b7b2-4b04cc8afe87 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.881970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b6cae-f2e9-4f03-b7b2-4b04cc8afe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.901347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-201b6cae-f2e9-4f03-b7b2-4b04cc8afe87 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:33.902894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-201b6cae-f2e9-4f03-b7b2-4b04cc8afe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:33.977757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 453/880] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:34.157293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd9c0-f05d-407f-9db7-2eb4c4cfe9a8 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.157635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd9c0-f05d-407f-9db7-2eb4c4cfe9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.157823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd9c0-f05d-407f-9db7-2eb4c4cfe9a8 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.159405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 428/881] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:34.165304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.169135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.169135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.184845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:34.186056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:34.249244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd9c0-f05d-407f-9db7-2eb4c4cfe9a8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.268259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 454/882] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:34.369035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd9c0-f05d-407f-9db7-2eb4c4cfe9a8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.405348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.406342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.406872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.407400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.408327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.410003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.415072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.514191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 429/883] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:34 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:08:34.556513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.597862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.676776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d8ce-b1ad-4b5c-812c-52047527391d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.726393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.727065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.727459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.727675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.740087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:34.745346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:34.746357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:34.747201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:34.748634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 455/884] 10.222.0.76 () {56 vars in 1120 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:34.752914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.889120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f5750-dabf-446a-b5be-29dd70e53705 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.934800 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.936066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.936581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.937096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.938001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:34.938551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.940192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.950954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 430/885] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:34.959837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.085101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.102345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ea79-502b-4450-95c5-00de6583a5e1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.151580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.152679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.153227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.153708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.165557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.167027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-be08f812-2ca0-47bd-95d3-a2c436de0253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:35.187745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:35.188706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:35.189702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:35.189702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:35.189702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:35.189702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 456/886] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:35.196404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.235241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7d052-9c9a-467b-875c-d5d26c394b2e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.235561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7d052-9c9a-467b-875c-d5d26c394b2e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.235800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7d052-9c9a-467b-875c-d5d26c394b2e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.237654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 457/887] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:35.244477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.244477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.244768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.267124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:35.268349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:35.278234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.340055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f25874-9788-4b2a-ba3a-4fcd0372cdac None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.343731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 458/888] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:35.382385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.383714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.384346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.385049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.386387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:35.387080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.388922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.403162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 431/889] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:35.409131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.485282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.519645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2c4b0-bb2a-47e2-b9ca-2b74f460b654 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.563614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.564364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.564591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.564907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.573458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.575049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:35.588525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:35.589567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:35.590488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 459/890] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:35.596204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.634190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.722852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dc50e-2325-4d00-a7dd-88c77d7bb40a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.744710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.759628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1679-9b9f-446e-adb5-fe1e009057d0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.763798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.764435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.764705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.771658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.771658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:35.771658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.771658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dfca4-fdee-4763-83c9-8aaf6886f0c5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.789607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 432/891] 10.222.0.76 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:35.791611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddd20c-509f-41b6-b2a2-ee4de5c9933e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.792099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddd20c-509f-41b6-b2a2-ee4de5c9933e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.792453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddd20c-509f-41b6-b2a2-ee4de5c9933e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.795181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 433/892] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:35.796340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddd20c-509f-41b6-b2a2-ee4de5c9933e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.799405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.802262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.803042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.803502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.803648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.804249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.805672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-cb6b9b34-8ad0-4794-8a4b-e408538cd5a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:35.814884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:35.818153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:35.819921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 460/893] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:35.821700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.821700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.821700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.838878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:35.840166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:35.922107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 461/894] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:35.922993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.947138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddd20c-509f-41b6-b2a2-ee4de5c9933e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.996783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.997435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.997720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.998051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.062867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.079798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb8a40-1df6-401b-b054-ecf36be65805 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.097079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.099677 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.115795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.130347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.131382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.131881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.132693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.133814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.134268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.136306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.148466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 462/895] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:36.154245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.240414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 434/896] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:36.241166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.293898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979599c-d09f-40c7-9b7d-eea436925f49 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.339563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.339765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.341384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.341384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.341384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.341672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.341876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.343267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.350841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 463/897] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:36.351903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.387382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb0fd-7300-4097-9d1d-495be0d0f4b9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.419912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.432379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.433020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.433305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.433610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.434277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.435780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.471644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c4d21-ec49-4271-aa47-42f74075009a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.513268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.514034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.514316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.514590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.530305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.531776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:36.550471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.551693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:36.552564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:36.552564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:36.552564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:36.556778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 464/898] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:36.557852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.558419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 435/899] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:36 2022] POST /identity/v3/services => generated 241 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:36.559373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.702368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b5991-79e0-4533-8e98-e679add0082d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.729221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77068-54cd-4498-b0f1-63e62de7763e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.739622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.748895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.755897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.757229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.757229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.757459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.758011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.758317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.759703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.780901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 436/900] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:36.787421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.791319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.792668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.793689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.794425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.795619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] RBAC: Adding query filter params (interface=public, service_id=9503cc5bd14143449c2a496fe4f34214, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.796165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.797892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.804951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 465/901] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/endpoints?service_id=9503cc5bd14143449c2a496fe4f34214&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:36.810865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.906177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20b70-d6ca-4502-a01c-6554fdf6573a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.922760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfa507-a48e-4eaa-acc0-cd26ce3b38ea None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.945756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.946535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.946872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.947101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.961760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.963282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.968830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acb0fb-2096-4dce-8265-ffa7940d8c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.969445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb0fb-2096-4dce-8265-ffa7940d8c28 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.969730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb0fb-2096-4dce-8265-ffa7940d8c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.970011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb0fb-2096-4dce-8265-ffa7940d8c28 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.970613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acb0fb-2096-4dce-8265-ffa7940d8c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.971994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acb0fb-2096-4dce-8265-ffa7940d8c28 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-00aaa3d7-ec1d-4ae6-92a5-d5a8a29d16e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:36.975808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.976699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:36.977717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 437/902] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:36.978687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cf464-5658-4296-98f5-d96519699e73 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.978795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cf464-5658-4296-98f5-d96519699e73 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.978988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cf464-5658-4296-98f5-d96519699e73 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.980405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 438/903] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:36.992979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 466/904] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:08:36.994731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cf464-5658-4296-98f5-d96519699e73 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.994861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.995199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.995399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.017753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:37.018992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:37.055597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.077895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.128506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 467/905] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:37.152957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cf464-5658-4296-98f5-d96519699e73 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.194844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.194844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.194844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.194844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.195520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.195861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.198854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.216882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 439/906] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:37.218635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.344169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bcbfb-76e4-45eb-9d7c-a46da5100eb6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.380433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.381374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.381853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.382302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.383225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] RBAC: Adding query filter params (role.id=18f6c2164cbb40dcbb90ab5169dfd9d1, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=9214312ee30a41e085e9038be016b6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.383721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.385352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.392019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 468/907] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/role_assignments?user.id=9214312ee30a41e085e9038be016b6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=18f6c2164cbb40dcbb90ab5169dfd9d1 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:37.403526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.544397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd00e-45a5-41b2-8f61-0e01ce6d778a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.563482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.607353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.608031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.608318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.608594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.609276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.610668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:37.621257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:37.623418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:37.625400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 440/908] 10.222.0.76 () {56 vars in 1132 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:37.637932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.675432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.760676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215910c4-25ab-4da7-91cc-3cb50e25279e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.800187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.800825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.801145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.801958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.802602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.802908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.804296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.809984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 469/909] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:37.818767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.971981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a16a8-9f40-447d-8f8b-b418756b588f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.014756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.015801 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.016292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.016773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.017680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.018215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.019821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.026477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 441/910] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.034690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.146707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.155956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22791042-0d45-423a-913e-440ee39ebe4b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.196924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.197923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.198427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.198908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.199852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] RBAC: Adding query filter params (interface=public, service_id=37c349ea46d0477fa8f136c9e9e72445, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.200367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.202309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2fe55-8e8e-485c-ae37-a2e516b72f7a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.209816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 470/911] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/endpoints?service_id=37c349ea46d0477fa8f136c9e9e72445&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.219260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.265138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.335756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a1c6-e643-42b6-bfbc-38874296b2a3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.372867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf44f4-7bcb-4fce-aae8-352dad85f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.373842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf44f4-7bcb-4fce-aae8-352dad85f5ae None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.374344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf44f4-7bcb-4fce-aae8-352dad85f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.374846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf44f4-7bcb-4fce-aae8-352dad85f5ae None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.375664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf44f4-7bcb-4fce-aae8-352dad85f5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.377294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf44f4-7bcb-4fce-aae8-352dad85f5ae None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.384463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 442/912] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:08:38.974334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73e38b-b612-402c-bcdd-fff4cf84607a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.974914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73e38b-b612-402c-bcdd-fff4cf84607a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.974914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73e38b-b612-402c-bcdd-fff4cf84607a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.976469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 471/913] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:38.983377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691fe2-8dba-4daa-992b-4a669a89f9d8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.984350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691fe2-8dba-4daa-992b-4a669a89f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.984911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691fe2-8dba-4daa-992b-4a669a89f9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.006101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-80691fe2-8dba-4daa-992b-4a669a89f9d8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:39.007678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-80691fe2-8dba-4daa-992b-4a669a89f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:39.086622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 443/914] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:39.173406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2badb10-226e-40eb-bcb8-ff23989ebff6 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.173751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2badb10-226e-40eb-bcb8-ff23989ebff6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.174036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2badb10-226e-40eb-bcb8-ff23989ebff6 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.175683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 472/915] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:39.181634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.181921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.182201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.201596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:39.202795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:39.232894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.277846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 444/916] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:39.381356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2badb10-226e-40eb-bcb8-ff23989ebff6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.496067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2badb10-226e-40eb-bcb8-ff23989ebff6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.533377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.534045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.534334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.534614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.535224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.536702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:39.557582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:39.558632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:39.559469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 473/917] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:39.565816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.569969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.605912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.688927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86295d0-5468-4fcd-b193-4545f90485a4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.693335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1292b0-8b78-4497-a1b1-322fadb70db8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.730659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.731276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.731597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.731881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.732551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.732879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.734263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.741993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.743472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.744272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 474/918] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:39.744553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.745206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.745469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.746427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.748258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:39.760207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:39.761264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:08:39.762117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:39.765857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 445/919] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:39.768922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.806729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.861195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.865727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aceae0-2b89-49c0-86dd-03a12114bbf2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.893340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed7960-4ee3-456b-964c-f0662f58efd0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.906523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.907206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.907491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.907767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.908505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.908833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.910203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2eb1c-395b-4bc0-93b4-2a22cf2e6225 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.916006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 475/920] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:39.917097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc5f6-bd3f-4735-89f9-5f9580fbffd9 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.917390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc5f6-bd3f-4735-89f9-5f9580fbffd9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.917666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc5f6-bd3f-4735-89f9-5f9580fbffd9 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.919255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 476/921] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:39.921995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc5f6-bd3f-4735-89f9-5f9580fbffd9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.934948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.935577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.935861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.936138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.936780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.937121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.938549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24616893-0a6e-4891-b035-0e1c3cae12bf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.943307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 446/922] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:39.943307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.945046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.945141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.964704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:39.965933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:40.036935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 447/923] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:40.036935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.049465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc5f6-bd3f-4735-89f9-5f9580fbffd9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.082460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.089838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.090651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.091083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.091507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.092358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] RBAC: Adding query filter params (interface=public, service_id=3118b0bb36434180b665360eec3b767e, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:40.099168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.099168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.100752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 477/924] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/endpoints?service_id=3118b0bb36434180b665360eec3b767e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:40.106051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.121719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.187087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46bac0-06d6-49c5-9d8d-a41f7459f16b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.216114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a2162-acf1-4764-9b6d-ec20c29ba692 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.237768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.239240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.239673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.240402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.241571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:40.242047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.244348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.256847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.256847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.256847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.256847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.257323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.257785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 448/925] 10.222.0.76 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:40.258981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.259385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.272944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 478/926] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:08:40.345409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.372124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.393915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211164d0-7a78-4e38-b9f1-0fe8e0a23df0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.435065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.440555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ffdbd-e45f-414b-9b22-9d4fc94a1ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.441269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffdbd-e45f-414b-9b22-9d4fc94a1ba6 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.441553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffdbd-e45f-414b-9b22-9d4fc94a1ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.442551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffdbd-e45f-414b-9b22-9d4fc94a1ba6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.443145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ffdbd-e45f-414b-9b22-9d4fc94a1ba6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.444564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ffdbd-e45f-414b-9b22-9d4fc94a1ba6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.461117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885f79b-db2a-4ba9-9373-ad2b6e3998b3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.496552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eeee17-7dec-4e3e-95fe-f60a209e43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.497217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eeee17-7dec-4e3e-95fe-f60a209e43a1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.497520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eeee17-7dec-4e3e-95fe-f60a209e43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.497831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eeee17-7dec-4e3e-95fe-f60a209e43a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.511452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eeee17-7dec-4e3e-95fe-f60a209e43a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c3eeee17-7dec-4e3e-95fe-f60a209e43a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:40.516344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:40.517407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:40.518264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 479/927] 10.222.0.76 () {56 vars in 1120 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:40.519353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bd5a1-4fae-4660-b680-5dde32dd74c4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.519353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bd5a1-4fae-4660-b680-5dde32dd74c4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.519628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bd5a1-4fae-4660-b680-5dde32dd74c4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.523393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 480/928] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:40.525682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bd5a1-4fae-4660-b680-5dde32dd74c4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.529883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 449/929] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:40.531149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.531438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.531716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.557919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:40.559184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:40.650594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 450/930] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:40.671836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bd5a1-4fae-4660-b680-5dde32dd74c4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.712198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.713081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.713503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.713915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.714924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:40.715227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.716580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.719525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.726778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 481/931] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:40.732514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.812322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.852650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185f457-61c8-408b-9ada-420085c0cb28 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.889168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.889892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.890181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.890464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.902489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.903884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:40.920471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:40.921491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:40.922352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:40.922352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:40.922352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:40.922352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 451/932] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:40.931580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.934423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.070926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efccad-3958-4d7e-8237-d68cd9134fdb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.088545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d90e66-3e0e-465a-aca1-b1f30cc8f54c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.108114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.108748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.109088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.109363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.109955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.111335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:41.121840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:41.129390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 452/933] 10.222.0.76 () {56 vars in 1132 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:41.130317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.132476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.146544 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.147532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.148017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.148904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.149798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.150673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.152611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.169556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 482/934] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.177705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.247019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.263599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b8bd-c82d-4050-b833-1739fcddb077 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.291055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e8e9-3f43-4cb9-9dab-1161b2dcd3b0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.305609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.306616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.307104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.307590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.308550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.309169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.310893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.317270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 453/935] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:41.329665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.338173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.338825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.339103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.339375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.347351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.349405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:41.361578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:41.362613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:41.368884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 483/936] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:41.371537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.402162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.485893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec55f-6bd2-4f56-974c-ec3f8401c72e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.498611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb55f6-66a5-4451-bf31-d721e2c08b95 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.521594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.527824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.529025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.529524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.529996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.530835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.531344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.533066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.543735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.544594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.544980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.545329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.546213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.546595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.548270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.553930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 454/937] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.560970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.579540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 484/938] 10.222.0.76 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:41.581190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.690477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af3746-cab4-477f-9047-d34e9b6807bf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.699922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d7a3-328f-4fb4-91a6-235f3253253b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.706277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.730112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.730976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.731432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.731843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.732694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.734421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.737497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.738088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.738371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.738684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.750574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.752214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:41.775067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:41.776236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:41.777154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:41.777154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:41.777154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:41.777154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 485/939] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:41.778884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.809754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.889212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 455/940] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:41.895743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258f48-e151-421e-b4d5-c9afd3dd8d43 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.973422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.974730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.975349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.975926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.977389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.978034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.980985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.006207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 486/941] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:42.016000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.150187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb829bff-682d-4988-a30b-8a8c4a80ffbe None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.193425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.194214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.194562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.194956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.202935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.204571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-10c2eadc-2919-434a-bd82-98930f820d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:42.217578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:42.218690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:42.219773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:42.220770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 456/942] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:42.227322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.293932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4420-c718-47b8-a392-1b102ba7884b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.294349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4420-c718-47b8-a392-1b102ba7884b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.294846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4420-c718-47b8-a392-1b102ba7884b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.297306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 457/943] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:42.305473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.305767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.306038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.333562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:42.334874 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:42.357510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.370999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.385822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b84ea-421e-45db-a305-50a34f133cfd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.422745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 458/944] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:42.427245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.428094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.428511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.428972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.429821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:42.430292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.431999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c084a5-600e-4bed-b92b-6484e05cb1af None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.445371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 487/945] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:42.451601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.589183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20437ea5-23bb-4130-98f0-77a21897e8e0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.652176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.653326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.653829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.654269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/9214312ee30a41e085e9038be016b6ee/roles/18f6c2164cbb40dcbb90ab5169dfd9d1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.658011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=9214312ee30a41e085e9038be016b6ee, role_id=18f6c2164cbb40dcbb90ab5169dfd9d1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.660898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.695745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5bc3-cad5-408c-bbd9-c2a5a08ca392 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.696078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5bc3-cad5-408c-bbd9-c2a5a08ca392 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.696312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5bc3-cad5-408c-bbd9-c2a5a08ca392 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.698284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 488/946] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:42.705083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.705747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.706248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.729678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:42.731865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:42.745961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 459/947] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:42 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/9214312ee30a41e085e9038be016b6ee/roles/18f6c2164cbb40dcbb90ab5169dfd9d1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:42.747257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.778077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.869103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 489/948] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:42.898954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5b044-84b9-49a5-9092-c148f6e3f37a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.946262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.946903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.947180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.947448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.948079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.949464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:42.961443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:42.962738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:42.963573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 460/949] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:42.968658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.050034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.077880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba079d6-4f76-4bc7-8715-c332d4c4c835 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.123051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.123604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.123887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.126109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.126914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:43.127226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.128881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.135291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 490/950] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:43.141658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.210576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.248468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.270122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f33b-af89-4b74-aff7-7eb7a2255e79 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.312157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.312927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.313236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.313515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.314189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:43.314500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.317366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.324347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 461/951] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:43.330490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.364514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b597cf-9387-4fb9-b333-a39233cf804b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.409452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.410644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.411285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.411789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.413081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.416471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.421554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING keystone.server.flask.common [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 19:08:43.438338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.464838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b2d32-a0ae-404e-805f-76b3bde717cf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.503220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.504036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.504426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.504765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.505540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.507056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.516867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.sql.core [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:08:43.516867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 19:08:43.516867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [parameters: {'id': 'c206e1df97f342c5a2600a651d213b9b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 19:08:43.516867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81649) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c206e1df97f342c5a2600a651d213b9b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c206e1df97f342c5a2600a651d213b9b. Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:08:43.535982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application result.read() Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 19:08:43.547635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application yield resource Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise self.value Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application session.commit() Aug 31 19:08:43.549599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:08:43.554106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:08:43.559144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application result.read() Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:08:43.562623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [parameters: {'id': 'c206e1df97f342c5a2600a651d213b9b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.567440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:43.569504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c206e1df97f342c5a2600a651d213b9b. Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 491/952] 10.222.0.76 () {60 vars in 1140 bytes} [Wed Aug 31 19:08:43 2022] POST /identity/v3/projects => generated 262 bytes in 335 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:43.571901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.614239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 462/953] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:43.691598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a97e2d-fa7e-437f-8383-d946c07d39ab None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.746626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.747752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.748404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.748941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.765457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.768656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-441f6d3e-a8c8-4756-8a9e-92bb1808f284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:43.782357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:43.783325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:43.784270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:43.787469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 492/954] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:43.796736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.801619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.932007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818f73-2c05-4fdf-9c98-c71416d8708e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.972961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.973812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.974255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.974708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.975779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:43.976236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.977736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34388bf-0b91-42d7-a0ba-6e68791bd3e1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.997959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 463/955] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:44.142675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd15a-2773-4e21-933a-a647a50adf2d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.142675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd15a-2773-4e21-933a-a647a50adf2d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.142675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd15a-2773-4e21-933a-a647a50adf2d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.145393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 493/956] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:44.151835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.152137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.152414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.181095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:44.183533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:44.285381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.296386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 464/957] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:44.647834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd15a-2773-4e21-933a-a647a50adf2d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.711705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.776343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd15a-2773-4e21-933a-a647a50adf2d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.818050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.819098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.819655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.820015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.820667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.822274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-db5c20c5-2e5b-454d-ac42-010b25e40b07 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:44.832247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:44.833344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:44.834252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 494/958] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:44.841543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.911359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851a141-b8d9-4b61-88a4-549aa4a64018 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.912219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851a141-b8d9-4b61-88a4-549aa4a64018 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.912499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851a141-b8d9-4b61-88a4-549aa4a64018 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.917977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 495/959] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:44.919599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.919889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.920194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.939499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:44.941076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:44.960703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe7805-237f-4866-a6d2-b4b8112fd853 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.005582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.007166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.007696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.008196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.009186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:45.009697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.011355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.021986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 465/960] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:45.023230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.032894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 496/961] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:45.091037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.139323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab272-2f2d-4e4b-ba71-e7291dd5369b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.183979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.185120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.185625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.186091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.186994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] RBAC: Adding query filter params (type=compute) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:45.187495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.189113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.195419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 466/962] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:45.342973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.392558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.453932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31db24-5ff4-4d12-ade4-ee272a59333c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.490712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.491518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.491899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.492267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.513963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:45.520974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:45.522120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:45.523698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:45.531563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 497/963] 10.222.0.76 () {56 vars in 1120 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:45.533977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.642784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c397ab-e0c9-42d1-888b-c929e817bdee None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.665691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.680909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.681538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.681819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.689816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.689816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:45.689816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.689816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074799cc-7e05-4d20-9f19-2768accdffe4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.699539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 467/964] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:45.701225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.812972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346a965-a2c9-439e-859c-11db4b1eabb4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.815335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.839138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af7e2-282a-40ac-b43c-8f8758689870 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.839457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af7e2-282a-40ac-b43c-8f8758689870 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.839692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af7e2-282a-40ac-b43c-8f8758689870 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.841323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 468/965] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:45.846376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cf47-ceb6-437f-9ee7-071c01545ae0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.846724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cf47-ceb6-437f-9ee7-071c01545ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.846933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cf47-ceb6-437f-9ee7-071c01545ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.850099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.850738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.851022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.851300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.865111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.866578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.868630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c208cf47-ceb6-437f-9ee7-071c01545ae0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:45.870641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c208cf47-ceb6-437f-9ee7-071c01545ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:45.884877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:45.885860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:45.886743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:45.886743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:45.886743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:45.888925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 498/966] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:45.894133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.956996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 469/967] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:46.011457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a43a7-e1bf-4491-a47a-df8d6a377d75 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.032406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181e5f-fbf4-4b7d-a333-109eb9217617 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.032697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181e5f-fbf4-4b7d-a333-109eb9217617 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.033007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181e5f-fbf4-4b7d-a333-109eb9217617 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.034635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 470/968] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:46.040511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.040820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.041121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.047790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.049486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.049780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.050060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.050877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:46.051686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.053091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.060189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:46.061478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:46.072775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 499/969] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:46.074053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.097183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.137164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 471/970] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:46.188390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c2b4-ff7e-4507-b367-2a7fa3a6478a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.226348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.226989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.227275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.227552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.235502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.237009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.242429 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:46.253205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:46.254796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:46.255767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 500/971] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:46.260992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.308957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.364758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.380566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da6bc-6fdb-479c-a35b-63e812094fd4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.399952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8cb6-896c-4c3e-b6fc-d7e55714c950 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.421654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.422588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.422978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.423354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.424116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.425781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:46.435651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:46.437003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.438498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 472/972] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:46.439323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.449953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.451175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.451468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.451746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.452828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:46.453146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.454589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.478507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 501/973] 10.222.0.76 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:46.478507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.567165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925c08-1f01-4190-85aa-55476c6eda9b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.576622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.605727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e8f7-3e6e-4b2d-be28-3dfbbe7e5594 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.606640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.607251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.607537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.607807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.608721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.610102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.612650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING keystone.server.flask.common [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 19:08:46.651487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.652239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.652523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.652813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.655318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:46.655318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.655318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.656514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.661252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 502/974] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:46.662099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.667548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.sql.core [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:08:46.667548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 19:08:46.667548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [parameters: {'user_id': 'aa28851982ee4dc2aaf4438d6c6ffcc3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 19:08:46.667548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81650) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result.read() Aug 31 19:08:46.681127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:08:46.682218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application yield resource Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise self.value Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application session.commit() Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:08:46.683387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:08:46.684743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:08:46.686089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result.read() Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:08:46.687135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aa28851982ee4dc2aaf4438d6c6ffcc3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:46.688236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 19:08:46.689471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:46.690615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 473/975] 10.222.0.76 () {60 vars in 1131 bytes} [Wed Aug 31 19:08:46 2022] POST /identity/v3/users => generated 160 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:46.691085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.786119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5099-a4f6-4691-b1ea-a95863a3b530 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.799598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e80c5-a872-4af0-92ca-0346ee5ba77a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.831488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.833094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.833528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.834015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.838579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.839206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.839493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.839769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.840415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:46.840724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.842391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.852494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 474/976] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:46.853216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.889216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.917422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.920662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.922189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.966642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608a84-689a-4d70-8ab0-374c99b26e40 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.002021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.003034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.003585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.004696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.014043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.015680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:47.029749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:47.032850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 475/977] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:47.033865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.043185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 503/978] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:47.043185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.146009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.153723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.157421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc0f8e-64bd-4bec-a2b8-5c65a6d3ef6b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.158945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2fbd8-f6a3-407a-8ad4-dd4e5e69f00c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.195613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.196229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.196530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.196780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.197589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] RBAC: Adding query filter params (interface=admin, service_id=3118b0bb36434180b665360eec3b767e, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:47.197827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.199215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.199623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.200335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.200618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.201193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.201906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:47.202208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.203639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.206363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 476/979] 10.222.0.76 () {56 vars in 1249 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/endpoints?service_id=3118b0bb36434180b665360eec3b767e&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:47.207527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.241778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 504/980] 10.222.0.76 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:47.242556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.350725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce979d-b389-4a7e-b7f3-49fad0f49318 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.377172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2e6cc-a331-4f64-8cd4-dd10928e235b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.397283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.397934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.398219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.399785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.412643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.414354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.422606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09b1c1-89cb-4166-940d-d54c7bdc6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.423499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09b1c1-89cb-4166-940d-d54c7bdc6c9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.423969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09b1c1-89cb-4166-940d-d54c7bdc6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.424401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09b1c1-89cb-4166-940d-d54c7bdc6c9b None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.425322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09b1c1-89cb-4166-940d-d54c7bdc6c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.427429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09b1c1-89cb-4166-940d-d54c7bdc6c9b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9ae32711-6d34-4245-9784-2dfd84516dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:47.429767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:47.430875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:47.431919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:47.431919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:47.431919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:47.431919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 477/981] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:47.432373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246aff-0fca-4fb1-bce5-2636cefec4b6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.432660 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246aff-0fca-4fb1-bce5-2636cefec4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.432959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246aff-0fca-4fb1-bce5-2636cefec4b6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.438206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 478/982] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:47.439790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 505/983] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:08:47.444831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97246aff-0fca-4fb1-bce5-2636cefec4b6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.445020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.445020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.445020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.458556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.465831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:47.467102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:47.488913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.578011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 506/984] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:47.607705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97246aff-0fca-4fb1-bce5-2636cefec4b6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.652904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.653542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.653821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.654096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.654761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:47.655066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.656495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.674672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 479/985] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:47.680796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.795027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a497e-a4d2-4aa0-bd3f-85759a0aeaf7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.834741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.835472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.835847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.836195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.844975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.846827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.853556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:47.862522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:47.864215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:47.865147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:47.869138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 507/986] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:47.870795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.882952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.935609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.969189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d55af-4ddb-410c-98ab-efccde2beaf8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.992818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227db4-2285-410d-b38a-e6de671bf80d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:48.004678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea105ad5-cd81-47fd-8779-8e07c4ba654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.005610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105ad5-cd81-47fd-8779-8e07c4ba654c None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.005895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105ad5-cd81-47fd-8779-8e07c4ba654c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.006171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105ad5-cd81-47fd-8779-8e07c4ba654c None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.006828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea105ad5-cd81-47fd-8779-8e07c4ba654c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:48.008205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea105ad5-cd81-47fd-8779-8e07c4ba654c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:48.028690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.029318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.029597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.029866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.030557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:48.030859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:48.032267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:48.043354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 508/987] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:48.061148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:48.119748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:48.150550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7330-0e61-484d-b440-129000ce2b96 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:48.182595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.183194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.183473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.183747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.184468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] RBAC: Adding query filter params (role.id=18f6c2164cbb40dcbb90ab5169dfd9d1, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=9214312ee30a41e085e9038be016b6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:48.184775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:48.186231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d50d4-e176-47ab-b71c-6e888e8867bd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:48.191748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 509/988] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:48 2022] GET /identity/v3/role_assignments?user.id=9214312ee30a41e085e9038be016b6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=18f6c2164cbb40dcbb90ab5169dfd9d1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:48.206747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 480/989] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:47 2022] POST /identity/v3/services => generated 242 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:08:49.414399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d177-a1e8-4481-97ad-c541b39ec94b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.415529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d177-a1e8-4481-97ad-c541b39ec94b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.415529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d177-a1e8-4481-97ad-c541b39ec94b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.417005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 510/990] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:49.424742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.425268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.425701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.452792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:49.454694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:49.533879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 481/991] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:49.817428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d177-a1e8-4481-97ad-c541b39ec94b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.954014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d177-a1e8-4481-97ad-c541b39ec94b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.988105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.988764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.989096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.989369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.989956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.991342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.993344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1bde96db-bd05-4344-91d5-72236c9188af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.001611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.002726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:50.015796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 511/992] 10.222.0.76 () {56 vars in 1126 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:50.016651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.076601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.123887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d13962-6c7e-41cb-98f2-24a312eafbe8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.166210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.166835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.167115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.167389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.168029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.168335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.169756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.180874 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 482/993] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:50.181109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6a24-1167-4d9f-aeca-339876cce0eb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.181109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6a24-1167-4d9f-aeca-339876cce0eb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.181109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6a24-1167-4d9f-aeca-339876cce0eb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.181109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 512/994] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:50.183434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.185673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5114a-3908-457d-a9e3-a4491b93276d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.185964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5114a-3908-457d-a9e3-a4491b93276d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.186243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5114a-3908-457d-a9e3-a4491b93276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.205808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-78b5114a-3908-457d-a9e3-a4491b93276d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:50.207091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-78b5114a-3908-457d-a9e3-a4491b93276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:50.281380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 513/995] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:50.282983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83964-21cc-4cb7-80c3-14ed131a47a4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.283275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83964-21cc-4cb7-80c3-14ed131a47a4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.283558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83964-21cc-4cb7-80c3-14ed131a47a4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.284984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 514/996] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:50.290140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d788b-f1be-4288-993c-2612b4db419d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.290469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d788b-f1be-4288-993c-2612b4db419d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.290704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d788b-f1be-4288-993c-2612b4db419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.298572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d4f2-a826-42f1-b347-05cf62d340be None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.310661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-002d788b-f1be-4288-993c-2612b4db419d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:50.311879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-002d788b-f1be-4288-993c-2612b4db419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:50.319360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.338578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.339109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.339395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.339671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.340314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.340622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.342140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.347156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 483/997] 10.222.0.76 () {56 vars in 1122 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:50.352509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.406377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 515/998] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:50.464638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37fa9-a79f-45dd-846d-6fbebb6f34ea None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.499046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.499655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.499935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.500206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.500887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.502251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.553501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d788b-f1be-4288-993c-2612b4db419d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.588969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 484/999] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:08:50.630934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.698915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.699946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d788b-f1be-4288-993c-2612b4db419d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.752568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.754218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.754218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.754218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.754659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.754948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.756673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.766584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.768073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:50.769064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 516/1000] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:50.773464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.828691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b5745-1781-4a29-be76-1afda5279a82 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.867984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.868550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.868860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.869140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] PATH_INFO: `/v3/services/image` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.869737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.871149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.884577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.885721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:50.886983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 485/1001] 10.222.0.76 () {56 vars in 1105 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:50.891696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.905228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb02d-df26-4c40-b7da-6b71dd70f076 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.926603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.948084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.949186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.949501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.949774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.950744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.951481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.952983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.958214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 517/1002] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:50.964045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.026323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8d06-4b7e-4873-a2b1-cfec639ab024 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.035480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.068158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.068777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.069089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.069362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.069990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] RBAC: Adding query filter params (name=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.070330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.071662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.080428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 486/1003] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.087739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.092606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c40aee-1aaa-4ee3-a1d7-a51ee39bfc3a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.138302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.138869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.139154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.139430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.140199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.140508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.142140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.153443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 518/1004] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:51.153968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.206151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cbaac-c814-4fa7-9ce4-3d679be96888 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.213314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.247726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.248353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.248654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.248966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.249619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.249925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.251388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.268840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 487/1005] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.291060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6c458-1220-4803-9c41-1e3943ea4c9d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.336382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.337394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.337833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.338259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.339216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] RBAC: Adding query filter params (interface=public, service_id=bce4c57b1c5547b3970748ce902eb73b, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.339646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.341163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ca9be-1b56-4d0f-9daf-6fba6f8c2b21 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.352790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 519/1006] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/endpoints?service_id=bce4c57b1c5547b3970748ce902eb73b&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.354896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.396640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.494109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c318-eeb0-4c86-84fa-4a4160a62ae5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.552880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d551-0466-4fbc-8a08-cb034d327916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.553878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d551-0466-4fbc-8a08-cb034d327916 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.554340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d551-0466-4fbc-8a08-cb034d327916 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.554799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d551-0466-4fbc-8a08-cb034d327916 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.555827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d551-0466-4fbc-8a08-cb034d327916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.558339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d551-0466-4fbc-8a08-cb034d327916 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.576841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 488/1007] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/services => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:08:52.564159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17f7f5-d8c7-4862-996c-9e0924961a7e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.564763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17f7f5-d8c7-4862-996c-9e0924961a7e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.564763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17f7f5-d8c7-4862-996c-9e0924961a7e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.566873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 520/1008] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:52.572055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.572658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.572658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.591698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:52.592940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:52.684901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 489/1009] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:52.952309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17f7f5-d8c7-4862-996c-9e0924961a7e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.081718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17f7f5-d8c7-4862-996c-9e0924961a7e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.093752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.131618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fadd60-7191-4fe1-87b1-ef130237ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.132332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fadd60-7191-4fe1-87b1-ef130237ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.132542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fadd60-7191-4fe1-87b1-ef130237ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.133041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fadd60-7191-4fe1-87b1-ef130237ab87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.134122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fadd60-7191-4fe1-87b1-ef130237ab87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.135651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fadd60-7191-4fe1-87b1-ef130237ab87 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.137601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 521/1010] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:53.143375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.176591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.265345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b50df3-3e80-4bd1-940f-431841c46a1b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.308358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea7e0-5ec6-4a65-a8b2-0f2736327bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.309007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea7e0-5ec6-4a65-a8b2-0f2736327bae None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.309290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea7e0-5ec6-4a65-a8b2-0f2736327bae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.309564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea7e0-5ec6-4a65-a8b2-0f2736327bae None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.310236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea7e0-5ec6-4a65-a8b2-0f2736327bae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.311680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea7e0-5ec6-4a65-a8b2-0f2736327bae None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.346845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116645-6ade-41e1-8ed0-c41896e22326 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.347134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116645-6ade-41e1-8ed0-c41896e22326 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.347448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116645-6ade-41e1-8ed0-c41896e22326 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.348874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 522/1011] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:53.354239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ecf4-e7e8-45bc-a556-08b518d122ab None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.354550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ecf4-e7e8-45bc-a556-08b518d122ab None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.354830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ecf4-e7e8-45bc-a556-08b518d122ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.375265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1293ecf4-e7e8-45bc-a556-08b518d122ab None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:53.380859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1293ecf4-e7e8-45bc-a556-08b518d122ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:53.412852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 490/1012] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:53 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:53.465348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 523/1013] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:53.588028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d6510-a0d6-4d9b-83e4-e2a69f2d80fa None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.588615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d6510-a0d6-4d9b-83e4-e2a69f2d80fa None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.588615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d6510-a0d6-4d9b-83e4-e2a69f2d80fa None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.589953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 491/1014] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:53.596376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.596967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.596967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.619751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:53.621038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:53.701103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 524/1015] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:53.734828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d6510-a0d6-4d9b-83e4-e2a69f2d80fa None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.834441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.857960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d6510-a0d6-4d9b-83e4-e2a69f2d80fa None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.900236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.901269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.901781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.902227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.903132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.904703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.975436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.011737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 492/1016] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:53 2022] POST /identity/v3/services => generated 242 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:54.021059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.100148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6543db-ee12-4163-8f40-069ffb78ddc1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.154005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.154740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.155018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.155291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.155889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.157368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:54.167562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:54.169675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:54.171401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 525/1017] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:54.176471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.300266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b726ac-a7b6-4725-8f75-52eb9d421183 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.341858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.342538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.342862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.343172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.343876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:54.344179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.345613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.354328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 493/1018] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:54.366746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.498720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.502864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be272e68-ec11-4baa-87a4-51a121808ef0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.547220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519cfb-2518-4309-8379-02d24649026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.547850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519cfb-2518-4309-8379-02d24649026d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.548129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519cfb-2518-4309-8379-02d24649026d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.548402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519cfb-2518-4309-8379-02d24649026d None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.550001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519cfb-2518-4309-8379-02d24649026d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:54.550001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519cfb-2518-4309-8379-02d24649026d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.550841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519cfb-2518-4309-8379-02d24649026d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.556592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 526/1019] 10.222.0.76 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:54.561977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.567472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.673140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424143fe-0514-484f-9d38-bbd140ee64cc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.709886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1ed9-e938-4c86-9979-424ff6bdef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.710497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1ed9-e938-4c86-9979-424ff6bdef49 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.710778 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1ed9-e938-4c86-9979-424ff6bdef49 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.711048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1ed9-e938-4c86-9979-424ff6bdef49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.711726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1ed9-e938-4c86-9979-424ff6bdef49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.713139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1ed9-e938-4c86-9979-424ff6bdef49 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.837581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 494/1020] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:55.443129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea90de-6882-441b-a153-c035be5c3e7e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.443656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea90de-6882-441b-a153-c035be5c3e7e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.443745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea90de-6882-441b-a153-c035be5c3e7e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.445378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 527/1021] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:55.451586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6b89-c6d7-44a3-aa68-9f198f1e43e0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.451870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6b89-c6d7-44a3-aa68-9f198f1e43e0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.452150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6b89-c6d7-44a3-aa68-9f198f1e43e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.486537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-10cf6b89-c6d7-44a3-aa68-9f198f1e43e0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:55.487760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-10cf6b89-c6d7-44a3-aa68-9f198f1e43e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:55.572276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:55.592292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 495/1022] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:55.884279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea90de-6882-441b-a153-c035be5c3e7e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.016122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c16f36-70e5-482b-b1c6-7a909e463b2a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.016684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c16f36-70e5-482b-b1c6-7a909e463b2a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.016684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c16f36-70e5-482b-b1c6-7a909e463b2a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.018060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 496/1023] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:56.023729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.024016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.024288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.027508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea90de-6882-441b-a153-c035be5c3e7e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.044850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:56.046152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:56.074446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.075088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.075963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.075963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.077039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.078476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.080090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 528/1024] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.085951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.120271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.147430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 497/1025] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:56.202383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7edc4f-eba7-45fd-be9a-75a17f747df0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.242376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.243458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.243458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.243647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.244260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.245775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.380838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 529/1026] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:56 2022] POST /identity/v3/users => generated 285 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:08:56.414713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.552309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d029d-3fda-4640-8ae9-1c2ce6c1ad38 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.573024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.592615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.593338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.593623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.593943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.594572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.596020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:56.607365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:56.608410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:08:56.609296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:56.611639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 498/1027] 10.222.0.76 () {56 vars in 1105 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:56.618532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.715290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.735572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eab20e-73ca-4ea9-9860-b104a8215be9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.781051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.781760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.782016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.782290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.782926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] RBAC: Adding query filter params (name=image) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.783225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.784599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.795408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 530/1028] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.797638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.936350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e2c7-8a6c-4381-ae28-8de0daad73a6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.986718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.987632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.988607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.989086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.990093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] RBAC: Adding query filter params (type=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.990594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.992756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372f57c-6850-4022-ba29-6d750c0580ae None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.998754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 499/1029] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:57.005331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.007650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7b84d-c650-4b4e-878b-247e60d67c09 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.007941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7b84d-c650-4b4e-878b-247e60d67c09 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.008216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7b84d-c650-4b4e-878b-247e60d67c09 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.009728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 500/1030] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:57.015242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.015535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.015815 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.037420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:57.039223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:57.090632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.121584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc919e-7770-4d94-9863-c7573de3e231 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.123553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 501/1031] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:57.158807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.159484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.159766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.160149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.160900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] RBAC: Adding query filter params (interface=public, service_id=38b0f4e1c76f4d4bb2a2eb2398da2f74, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:57.161209 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.162606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.173858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 531/1032] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/endpoints?service_id=38b0f4e1c76f4d4bb2a2eb2398da2f74&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:57.176303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.295743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b107eb-a7cd-48e6-97ba-4edbde059e42 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.342446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.343051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.343328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.343675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.344389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.345781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.360896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 502/1033] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:08:57.400765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.419419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.535221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412be65-a0d7-4346-8b3e-705bf1fd5d80 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.585620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.586376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.586739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.587090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.600900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:57.605802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:57.606859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:57.607912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 532/1034] 10.222.0.76 () {56 vars in 1120 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:57.614025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.665245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.739372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db90d7-47b1-44af-a9c7-91efb271bbf7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.778963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046846-308a-4479-acea-508356565f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.779585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046846-308a-4479-acea-508356565f4f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.779867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046846-308a-4479-acea-508356565f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.780140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046846-308a-4479-acea-508356565f4f None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.780828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046846-308a-4479-acea-508356565f4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:57.781152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046846-308a-4479-acea-508356565f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.782587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046846-308a-4479-acea-508356565f4f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.792305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 503/1035] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:57.797857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.887725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.929312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b585f2b-1e6f-4386-9334-b339416b5516 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.966195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.966837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.967112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.967388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.979204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.980655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:57.995805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:57.997680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:57.998599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:57.998599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:57.998599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:57.999280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 533/1036] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:58.003051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046846-308a-4479-acea-508356565f4f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.133022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.137292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046846-308a-4479-acea-508356565f4f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.177357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.177894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.178234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.178515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.179167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.179475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.180881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.195314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 504/1037] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:58.201088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.318260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5bbe1-cca1-4d4d-810c-e8d1c16c7329 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.350930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.361853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.362589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.373022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.373022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.373022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.373583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f3aa1a42-700c-4377-916f-88b918f92417 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:58.385810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:58.386854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:58.387803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:58.389114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 534/1038] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:58.392909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.518960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301b28-20f3-4fcc-9975-3b02c3d52ada None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.549337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c728-1e7d-4bf1-84d9-c10615fc45ec None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.549874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c728-1e7d-4bf1-84d9-c10615fc45ec None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.550848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c728-1e7d-4bf1-84d9-c10615fc45ec None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.552675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 535/1039] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:58.558413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.558694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.559031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.577107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.578074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.578583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.579087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.579280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:58.580505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:58.580623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.581616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.583649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.607357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 505/1040] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:58.613410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.641010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.662514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 536/1041] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:58.752214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b56bb-7674-4bd1-b1f1-f4840598bdd9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.789653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.790180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.790458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.790727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.860856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.862298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.882610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.938541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.971382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 506/1042] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:08:58.976772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.056277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d737-c5b8-4e42-a3cc-1500528a96f8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.087127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.112283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dfca6-e75e-4a3a-90d6-13495b907421 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.114815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.115468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.115762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.116898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.129017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:59.134087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:59.135146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:08:59.136127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 537/1043] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:59.138350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.141367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.159392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.160143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.160497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.160775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.172826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.174295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:59.189555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:59.190645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:59.192115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:59.192115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:59.192115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:59.192115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 507/1044] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:59.197101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.262907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9fd8e-cbe2-47ed-9b3a-3f45f348072a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.311964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4c78b-03ca-4bdc-a6f1-a8c95f22b362 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.313850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.314489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.314768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.315050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.315734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.316710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.318173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.327864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 538/1045] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.334576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.368387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.369302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.369467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.369716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.370415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.370736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.372161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.384461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.390640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 508/1046] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.391817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.424674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.455909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedb253-0b95-4cf6-9839-45c6bd62e6b5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.491379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1f20c-5297-446f-b82d-a57bacc8d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.492031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f20c-5297-446f-b82d-a57bacc8d418 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.492311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f20c-5297-446f-b82d-a57bacc8d418 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.492588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f20c-5297-446f-b82d-a57bacc8d418 None admin] PATH_INFO: `/v3/users/74289b8f4ed04bf19c7ab7122e08224a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.506453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6d50-e35d-41bd-b2bd-fe61b80d3748 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.507651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1f20c-5297-446f-b82d-a57bacc8d418 None admin] RBAC: Authorizing `identity:get_user(user_id=74289b8f4ed04bf19c7ab7122e08224a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.509161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1f20c-5297-446f-b82d-a57bacc8d418 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.510887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 539/1047] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/users/74289b8f4ed04bf19c7ab7122e08224a => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.512104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5336-7edf-49f2-868d-9173aec7dca0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.512379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5336-7edf-49f2-868d-9173aec7dca0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.512667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5336-7edf-49f2-868d-9173aec7dca0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.516834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 540/1048] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:59.519506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.519790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.520066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.539551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:59.540772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:59.551491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.552137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.552413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.552681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.560118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.561623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:59.573283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:59.574688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 509/1049] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:59.575941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.619938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 541/1050] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:59.620952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.654812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.697396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.707935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe344a-5af1-41d3-8c53-4a7391d7dab1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.736970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adf07e-8412-4a58-a83b-fac074e73ca8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.746565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.747209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.747717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.748436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.777851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.778471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.778753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.779025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.779720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.780018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.781506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.794221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 542/1051] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:59.800322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.832913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.835540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.899532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.916876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9b81-2c67-41f3-9870-432718714a94 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.941777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.952732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 510/1052] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:59.953624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.955667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.956288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.956609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.956914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.958049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] RBAC: Adding query filter params (role.id=18f6c2164cbb40dcbb90ab5169dfd9d1, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=0257d1031cbe49f0b2565286946ec6ee) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.958425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.960084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.966480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 543/1053] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/role_assignments?user.id=0257d1031cbe49f0b2565286946ec6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=18f6c2164cbb40dcbb90ab5169dfd9d1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.967357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.099400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6fe6-e543-4763-a23b-343fa1fbb316 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.102060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1d1b1-9df4-485f-98f7-a03b9a89799b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.142341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.143157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.143494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.143766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] PATH_INFO: `/v3/services/image` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.144355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.145825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.146416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.147171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.147458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.147743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.150025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] RBAC: Authorizing `identity:get_project(project_id=1a7abe6f1ff94b32a0e9a070532d0f80)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.151555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.158705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 544/1054] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:00.158935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:00.160007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:00.162237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:00.166222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.170858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 511/1055] 10.222.0.76 () {56 vars in 1105 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:00.170858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.190452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.243576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.294892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566110d3-4b84-4d91-b0d3-23c93b3a7450 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.300209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf0f36-7eef-4854-862a-6247186b2209 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.337389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.338106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.338350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.338600 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.339601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80, user.id=74289b8f4ed04bf19c7ab7122e08224a) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:00.339988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.342268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.346723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.347872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.348153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.348427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.349083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] RBAC: Adding query filter params (name=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:00.349387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.358777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 545/1056] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/role_assignments?user.id=74289b8f4ed04bf19c7ab7122e08224a&scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:00.359233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.359233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 512/1057] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:00.365971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.476342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.502867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e261-daca-48df-bf99-02df619366b4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.547910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.548537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.548854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.549197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.549849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] RBAC: Adding query filter params (type=image) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:00.550175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.551583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3122a-0b30-4083-aead-768f0a490b6b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.563312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 546/1058] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:00.565205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.708124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aebd4-6d3c-4942-b228-bca9827abe3c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.732844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.754061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84a211-409e-48b8-801f-24245e4de936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.754691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84a211-409e-48b8-801f-24245e4de936 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.754955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84a211-409e-48b8-801f-24245e4de936 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.755228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84a211-409e-48b8-801f-24245e4de936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.755918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84a211-409e-48b8-801f-24245e4de936 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.757328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84a211-409e-48b8-801f-24245e4de936 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.883485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 513/1059] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:01.913591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b3f43-0ed7-4dac-b6d2-7531045c2e71 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.914123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b3f43-0ed7-4dac-b6d2-7531045c2e71 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.914123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b3f43-0ed7-4dac-b6d2-7531045c2e71 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.915647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 547/1060] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:01.920847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.921355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.921452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.940303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:01.942048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:02.025060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 514/1061] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:02.307633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c26ef-2b04-4377-adba-dcbedfeb122a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.307838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c26ef-2b04-4377-adba-dcbedfeb122a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.308118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c26ef-2b04-4377-adba-dcbedfeb122a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.309474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 548/1062] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:02.311866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.315048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.315267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.315538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.336000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:02.337313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:02.428314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 549/1063] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:02.445968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.448988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9227b-c238-49a0-ab11-81a178a9cc51 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.493722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.494368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.494652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.495096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.506816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:02.511737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:02.512871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:02.514972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 515/1064] 10.222.0.76 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:02.519743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.613778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.640606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3588b-0868-4435-924e-94e48bb59527 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.680177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.680792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.681101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.681380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.682057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:02.682360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.683837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.701006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 550/1065] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:02.702542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.725611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.816285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22188-4d61-4665-9a45-307624890377 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.844469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d7714-66f2-4ba4-99b2-5759ea459134 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.855896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.856541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.856851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.857130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.870941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.872663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.887818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c4738-cfd0-44ce-9587-b0522f46a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.888461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4738-cfd0-44ce-9587-b0522f46a56e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.888745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4738-cfd0-44ce-9587-b0522f46a56e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.889051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4738-cfd0-44ce-9587-b0522f46a56e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:02.892704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:02.894781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:02.896907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:02.896907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:02.896907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:02.899442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 516/1066] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:02.900374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.901183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.906509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c4738-cfd0-44ce-9587-b0522f46a56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-437c4738-cfd0-44ce-9587-b0522f46a56e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:02.912086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:02.915422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 551/1067] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:02.916298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401de2-5dfd-4299-bd12-50c20311d9d3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.917162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401de2-5dfd-4299-bd12-50c20311d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.917162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401de2-5dfd-4299-bd12-50c20311d9d3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.917162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 552/1068] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:02.919848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a401de2-5dfd-4299-bd12-50c20311d9d3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.923261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.020017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c696-4265-4e2a-88b1-586e4d447b1e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.036220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a401de2-5dfd-4299-bd12-50c20311d9d3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.060092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.060710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.061025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.061306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.061955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:03.062264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.063646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a913f-7b5e-4688-93f3-512ac7f510fb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.071745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.072355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.072640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.073634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.073634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:03.073919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.075275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.076597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 517/1069] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:03.077885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.078173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.078451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.093334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 553/1070] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:03.093334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.100732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:03.101984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:03.155850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.171769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 518/1071] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:03.172544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.175213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.203917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eba1d4-2e83-43be-9c5c-4652eb4f3009 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.247339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.247978 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.248269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.248541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.258817 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.260753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:03.275129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:03.276169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:03.277150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:03.281468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 554/1072] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:03.282385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.291560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09c8dc-3448-44fe-afd6-c0d16b451391 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.332388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.333070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.333352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.333627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] PATH_INFO: `/v3/users/74289b8f4ed04bf19c7ab7122e08224a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.334812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] RBAC: Authorizing `identity:get_user(user_id=74289b8f4ed04bf19c7ab7122e08224a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.336278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.338056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 519/1073] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/users/74289b8f4ed04bf19c7ab7122e08224a => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:03.343925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.407979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1e47-83c1-44cd-8441-4b1a733c61e5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.425315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.431697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.447070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.447696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.447974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.448254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.449499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:03.449499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.451038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.460824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d2ac7-5452-4fa0-b24e-7b42050aeb09 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.470963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 555/1074] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:03.471819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.497081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.497725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.498009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.498289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.499464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] RBAC: Authorizing `identity:get_project(project_id=1a7abe6f1ff94b32a0e9a070532d0f80)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.500954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.502917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 520/1075] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:03.504002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.592760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137656b2-fa0f-4bc0-aea4-eb0b7df0478a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.617442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824ea15-4759-49bd-a8cd-c5e21d0d16ea None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.628366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.629004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.629364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.629635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.654273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.654906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.655189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.655496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.663839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.667906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.669406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.681165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:03.684414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:03.685679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:03.686934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:03.686934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:03.686934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:03.686934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 521/1076] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:03.686934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.705606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.707569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.792544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ddd88-d432-4544-b2e0-198747b15dca None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.811948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 556/1077] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:03.813065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.831779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.832499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.832780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.833084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80/users/74289b8f4ed04bf19c7ab7122e08224a/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.835019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a7abe6f1ff94b32a0e9a070532d0f80, user_id=74289b8f4ed04bf19c7ab7122e08224a, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.836468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.892420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.917001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adbda-3f22-4b2b-b70a-cf0fd087e070 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.928207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 522/1078] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:03 2022] PUT /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80/users/74289b8f4ed04bf19c7ab7122e08224a/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:03.929145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.961007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.961007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.961007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.961007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.962042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:03.962469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.964023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.980789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 557/1079] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:03.986717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.000849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.067184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89fae0-e085-4e4e-9955-c1920c4318b2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.109847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.110488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.110774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.111060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.115132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3bb7-b3df-4893-a698-e93bd81c4a1d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.122425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.124517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:04.140707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:04.141945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:04.142988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:04.142988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:04.142988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:04.142988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 523/1080] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:04.148777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.171941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.172980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.174756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.174756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.181860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.183334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.185574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:04.197257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:04.198392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:04.199638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:04.200260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 558/1081] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:04.205918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.273888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da01d-95fa-4397-a12e-508952638ee3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.275720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.321050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.322083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.322632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.322905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.323564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:04.323868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.325676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.334118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531823e1-a951-48cc-9c90-ec9a851bef20 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.342373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 524/1082] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:04.380446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.381300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.381677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.382052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.382868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:04.383288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.386049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dda2c8-d3dc-4535-980e-07061d304c76 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.408038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 559/1083] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:04.413084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.535033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f37b8-f17a-45a8-8fc2-f8f7e6da6f7d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.581422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345e84b-fdec-4534-b3eb-b3f5634863ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.582266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e84b-fdec-4534-b3eb-b3f5634863ab None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.582650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e84b-fdec-4534-b3eb-b3f5634863ab None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.583038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e84b-fdec-4534-b3eb-b3f5634863ab None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/0257d1031cbe49f0b2565286946ec6ee/roles/18f6c2164cbb40dcbb90ab5169dfd9d1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.585395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345e84b-fdec-4534-b3eb-b3f5634863ab None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=0257d1031cbe49f0b2565286946ec6ee, role_id=18f6c2164cbb40dcbb90ab5169dfd9d1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.586953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345e84b-fdec-4534-b3eb-b3f5634863ab None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.676663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 525/1084] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:04 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/0257d1031cbe49f0b2565286946ec6ee/roles/18f6c2164cbb40dcbb90ab5169dfd9d1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:05.877367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74c69e-d0d1-4cf8-a54f-b99f8efcb685 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.877906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74c69e-d0d1-4cf8-a54f-b99f8efcb685 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.877906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74c69e-d0d1-4cf8-a54f-b99f8efcb685 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.879822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 560/1085] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:05.885213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.885681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.885911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.904283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:05.906105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:05.923712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:05.979412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 526/1086] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:06.249820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74c69e-d0d1-4cf8-a54f-b99f8efcb685 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:06.314327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:06.358751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74c69e-d0d1-4cf8-a54f-b99f8efcb685 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:06.395215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:06.395964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.396240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.396513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.407501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:06.412815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:06.414016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:06.415032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:06.416963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 561/1087] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:06.419954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:06.533414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd1a4d-8db7-45fd-b877-e0a5e8b00f95 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:06.579167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:06.579782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.580071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.580344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.581073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:06.581415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:06.582807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616ea48-d9e3-4957-8718-cd707a44538f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:06.591859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 527/1088] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:06.599059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:06.623774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e90ac-1ea3-4b9d-bc3e-76de7284f649 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.624057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e90ac-1ea3-4b9d-bc3e-76de7284f649 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.624330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e90ac-1ea3-4b9d-bc3e-76de7284f649 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.625744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 528/1089] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:06.631511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.631789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.632067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.656276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:06.657815 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:06.671264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:06.712705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac70b13-e0b0-483f-89a6-189b3452a17a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:06.736850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 529/1090] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:06.737064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:06.755610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:06.756253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.756531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.756924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] PATH_INFO: `/v3/users/74289b8f4ed04bf19c7ab7122e08224a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.758089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] RBAC: Authorizing `identity:get_user(user_id=74289b8f4ed04bf19c7ab7122e08224a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:06.759509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:06.761152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 562/1091] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:06 2022] GET /identity/v3/users/74289b8f4ed04bf19c7ab7122e08224a => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:06.767814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:06.879552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f8ec5-d11b-4cb0-8094-72d67941f9ef None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:06.916449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:06.917118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.917359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.917630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.934180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:06.997269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:06.999796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.003636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.109474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 530/1092] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:07.110924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa94e-bcae-457d-8d91-9427673a8989 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.115538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.153045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.153710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.154003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.154277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.165353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:07.166080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:07.172399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:07.173627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:07.174543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 563/1093] 10.222.0.76 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:07.180697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.228828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74028-f2b9-425a-a3bf-949eaf763316 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.232348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.267561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.268230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.268516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.269449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.270588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] RBAC: Authorizing `identity:get_project(project_id=1a7abe6f1ff94b32a0e9a070532d0f80)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.272044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.273744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 531/1094] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:07.279930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.292526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a88b2-13ce-46a8-a7bd-96ebdc230fa5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.329752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.330367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.330653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.330932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.332211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:07.332513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.333952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.343409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 564/1095] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:07.352138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.397291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec204-626d-4fba-bbfa-4b12825ebfff None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.411983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.442187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.442808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.443085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.443358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.446229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80, user.id=74289b8f4ed04bf19c7ab7122e08224a) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:07.446229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.446229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.452973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 532/1096] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/role_assignments?user.id=74289b8f4ed04bf19c7ab7122e08224a&scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:07.469121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d53be9-58c5-4240-929a-b64d11917414 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.480880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.511119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.511797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.512077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.512350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.524562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.526097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:07.544353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:07.551768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:07.552701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:07.552701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:07.552701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:07.552701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 565/1097] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:07.552984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.671770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63dce-a234-44b6-b57b-d9098221bfd3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.709375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.709985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.710268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.710543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.711197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:07.711504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.712909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.725713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 533/1098] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:07.731638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.840517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869996f4-7cdc-48d9-8fcc-52e83dccd518 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.876746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.877418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.877706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.878020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.886467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.887927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:07.899830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:07.901009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:07.902891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 566/1099] 10.222.0.76 () {56 vars in 1093 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:07.906897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.948403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.025594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf775b-06a4-468b-8619-e317ed388b96 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.062948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.063573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.063857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.064133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.064924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:08.065232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.066705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.087123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 534/1100] 10.222.0.76 () {56 vars in 1133 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:08.093132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.117461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.209035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba19d-e2a6-4de9-b414-33e260f37a9e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.257520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.258141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.258419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.258687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.340837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.342315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.365115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.457763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 567/1101] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:08.463569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.560449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.566771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aed31-5bf1-4856-8ecb-5e7e5d2a1ae8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.599985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.600617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.600930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.601209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.611561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.613697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:08.629415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:08.630605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:08.631479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:08.631479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:08.631479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:08.631479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 535/1102] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:08.636372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.745214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76d7b-72d3-4110-b5b5-6feada62e007 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.767336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.782557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.783168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.783441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.783713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.784892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:08.785194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.786571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.803717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 568/1103] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:08.804952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.920118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a85c5b-cbc9-40ca-8975-4c90c92f923a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.955498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.956666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.956981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.957255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.964385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.965929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:08.978969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:08.980092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:08.981854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:08.985017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 536/1104] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:08.986199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.100349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175974e4-a8e3-4384-9008-e9f9915357f4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.135586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.137383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.137383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.137383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.137692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:09.137780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.139200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7220e9-a55f-4b72-8b5c-113eea3cfb5f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.153270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 569/1105] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:09.160219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.171383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:09.273823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39db0-c716-42df-930a-c384d2f0b064 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.308734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.309372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.309652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.309925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.310843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] RBAC: Adding query filter params (role.id=18f6c2164cbb40dcbb90ab5169dfd9d1, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=0257d1031cbe49f0b2565286946ec6ee) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:09.311150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.312585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98635a88-2003-4687-b4c4-aecac29b26bb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.328835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 537/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/role_assignments?user.id=0257d1031cbe49f0b2565286946ec6ee&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=18f6c2164cbb40dcbb90ab5169dfd9d1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:09.481303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0ef3-9fae-4801-ae63-b01f36830589 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.481510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0ef3-9fae-4801-ae63-b01f36830589 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.481784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0ef3-9fae-4801-ae63-b01f36830589 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.483126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 570/1107] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:09.488858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.489158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.489447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.509474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:09.510688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:09.589448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:09.596842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 538/1108] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:09.864543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0ef3-9fae-4801-ae63-b01f36830589 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.918249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:09.991680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0ef3-9fae-4801-ae63-b01f36830589 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.044959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab5bbf-b396-4baa-980d-dbe793ff5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.045961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab5bbf-b396-4baa-980d-dbe793ff5b7c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.046422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab5bbf-b396-4baa-980d-dbe793ff5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.046878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab5bbf-b396-4baa-980d-dbe793ff5b7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.048700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab5bbf-b396-4baa-980d-dbe793ff5b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.051229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab5bbf-b396-4baa-980d-dbe793ff5b7c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.052916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 571/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:10.065900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.185916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463483-5eac-46fb-87aa-3907019d3a45 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.227203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067bcc-2089-48ed-bdcc-274f6c28b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.227826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067bcc-2089-48ed-bdcc-274f6c28b75f None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.228116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067bcc-2089-48ed-bdcc-274f6c28b75f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.228427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067bcc-2089-48ed-bdcc-274f6c28b75f None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.229225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39067bcc-2089-48ed-bdcc-274f6c28b75f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.230692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39067bcc-2089-48ed-bdcc-274f6c28b75f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.384947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 539/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:09:10 2022] POST /identity/v3/users => generated 286 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:12.360307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b796dc-18a0-4c98-a444-03ca105a2c7e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.360876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b796dc-18a0-4c98-a444-03ca105a2c7e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.360876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b796dc-18a0-4c98-a444-03ca105a2c7e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.362926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 572/1111] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:12.368398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.368825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.368992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.389738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:12.390960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:12.442648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:12.459944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 540/1112] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:12.741087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b796dc-18a0-4c98-a444-03ca105a2c7e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:12.846403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b796dc-18a0-4c98-a444-03ca105a2c7e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:12.857731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:12.884165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:12.884791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.885106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.885385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] PATH_INFO: `/v3/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.886993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] RBAC: Authorizing `identity:get_role(role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:12.888797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:12.890174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 573/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:12 2022] GET /identity/v3/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:12.896124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:12.999771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655cd3-fe69-40e7-886f-0e1f1ca3ccdd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.036433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.037103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.037389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.037666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] PATH_INFO: `/v3/users/627f7203bb334c30b2b2f61197c06bde` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.051815 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=627f7203bb334c30b2b2f61197c06bde)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:13.053306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:13.055002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 541/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:12 2022] GET /identity/v3/users/627f7203bb334c30b2b2f61197c06bde => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:13.061506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.164107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6ac2-6543-47c9-a997-305a892fbf66 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.255086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.255601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.255880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.256153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.302633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:13.327117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:13.328576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:13.433219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 574/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:13.439354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.490041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:13.549032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8caa47-a983-443a-b882-8eb7ec96d8e4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.585132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5db2-5a40-4196-b33c-ae7d401f0d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.585788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5db2-5a40-4196-b33c-ae7d401f0d79 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.586072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5db2-5a40-4196-b33c-ae7d401f0d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.586348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5db2-5a40-4196-b33c-ae7d401f0d79 None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.587530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5db2-5a40-4196-b33c-ae7d401f0d79 None admin] RBAC: Authorizing `identity:get_project(project_id=1a7abe6f1ff94b32a0e9a070532d0f80)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:13.589107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5db2-5a40-4196-b33c-ae7d401f0d79 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:13.590885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 542/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:13 2022] GET /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:13.598214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.683553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:13.706999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa717-7e53-4b32-af18-85fd5c3e24dc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.742555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.743176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.743490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.743795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.744757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] RBAC: Adding query filter params (role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80, user.id=627f7203bb334c30b2b2f61197c06bde) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:13.745106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:13.746558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f010507-3464-4ab2-9672-60f94b99c46c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:13.752065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 575/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:13 2022] GET /identity/v3/role_assignments?user.id=627f7203bb334c30b2b2f61197c06bde&scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.638987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8242c8-8467-4ed3-8042-871acd5c4bd9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.639532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8242c8-8467-4ed3-8042-871acd5c4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.639685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8242c8-8467-4ed3-8042-871acd5c4bd9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.640974 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 543/1118] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:15.651844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157647-328e-4512-99fb-2a318d33f79b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.651844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157647-328e-4512-99fb-2a318d33f79b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.651844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157647-328e-4512-99fb-2a318d33f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.666754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-19157647-328e-4512-99fb-2a318d33f79b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:15.668011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-19157647-328e-4512-99fb-2a318d33f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:15.736153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 576/1119] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:16.006145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8242c8-8467-4ed3-8042-871acd5c4bd9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:16.109113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8242c8-8467-4ed3-8042-871acd5c4bd9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:16.124921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:16.145314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:16.145951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:16.146250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:16.146506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] PATH_INFO: `/v3/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:16.147894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] RBAC: Authorizing `identity:get_role(role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:16.149299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:16.150633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 544/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:16 2022] GET /identity/v3/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:16.156584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157647-328e-4512-99fb-2a318d33f79b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:16.226719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:16.257382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157647-328e-4512-99fb-2a318d33f79b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:16.292740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:16.293427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:16.293750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:16.294092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] PATH_INFO: `/v3/users/627f7203bb334c30b2b2f61197c06bde` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:16.295273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] RBAC: Authorizing `identity:get_user(user_id=627f7203bb334c30b2b2f61197c06bde)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:16.296794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:16.298477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 577/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:16 2022] GET /identity/v3/users/627f7203bb334c30b2b2f61197c06bde => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:16.304928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:16.408186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338d0d-6b13-424f-9efe-00edef534c85 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:16.442169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f19e-e04e-4430-a53f-22520fd01614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:16.442803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f19e-e04e-4430-a53f-22520fd01614 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:16.443084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f19e-e04e-4430-a53f-22520fd01614 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:16.443358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f19e-e04e-4430-a53f-22520fd01614 None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:16.444472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f19e-e04e-4430-a53f-22520fd01614 None admin] RBAC: Authorizing `identity:get_project(project_id=1a7abe6f1ff94b32a0e9a070532d0f80)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:16.445943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f19e-e04e-4430-a53f-22520fd01614 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:16.447573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 545/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:16 2022] GET /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:16.453991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:16.557860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4c69a-ce97-4747-a77d-656d8650e42f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:16.592554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885617c-0f7f-4f9a-b9ab-71b290b00664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:16.593269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885617c-0f7f-4f9a-b9ab-71b290b00664 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:16.593593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885617c-0f7f-4f9a-b9ab-71b290b00664 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:16.593925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885617c-0f7f-4f9a-b9ab-71b290b00664 None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80/users/627f7203bb334c30b2b2f61197c06bde/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:16.596161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885617c-0f7f-4f9a-b9ab-71b290b00664 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a7abe6f1ff94b32a0e9a070532d0f80, user_id=627f7203bb334c30b2b2f61197c06bde, role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:16.598581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885617c-0f7f-4f9a-b9ab-71b290b00664 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:16.688210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:16.694466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 578/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:16 2022] PUT /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80/users/627f7203bb334c30b2b2f61197c06bde/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:18.587977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a3c5-975f-473b-8651-aefa535df657 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.588522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a3c5-975f-473b-8651-aefa535df657 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.588615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a3c5-975f-473b-8651-aefa535df657 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.589932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 546/1124] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:18.595239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.595707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.595881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.615474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:18.616731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:18.683620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 579/1125] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:18.954190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a3c5-975f-473b-8651-aefa535df657 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.005306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.057691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a3c5-975f-473b-8651-aefa535df657 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.091363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.091983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.092262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.092532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] PATH_INFO: `/v3/roles/340eacc70a83414ebbe72f2f23baeca1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.093945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] RBAC: Authorizing `identity:get_role(role_id=340eacc70a83414ebbe72f2f23baeca1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.095316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.097222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 547/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/roles/340eacc70a83414ebbe72f2f23baeca1 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:19.103186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.208052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc3cf-54d0-4fed-b15b-08365c31944f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.235193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.243173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.243834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.244155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.251130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] PATH_INFO: `/v3/users/627f7203bb334c30b2b2f61197c06bde` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.251130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] RBAC: Authorizing `identity:get_user(user_id=627f7203bb334c30b2b2f61197c06bde)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.251130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.251130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 580/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/users/627f7203bb334c30b2b2f61197c06bde => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:19.255364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.355779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2f26-486b-44e8-bd49-ffe02aee8103 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.372633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.391591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.392201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.392484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.392760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.460205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.461602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.563287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 548/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:19.569969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.669360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb36dd-6d1d-46e9-9608-56950a84b695 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.703881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398796-f7aa-4dd1-acef-0e0bdddb1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.704532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398796-f7aa-4dd1-acef-0e0bdddb1a26 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.704872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398796-f7aa-4dd1-acef-0e0bdddb1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.705215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398796-f7aa-4dd1-acef-0e0bdddb1a26 None admin] PATH_INFO: `/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.706942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18398796-f7aa-4dd1-acef-0e0bdddb1a26 None admin] RBAC: Authorizing `identity:get_project(project_id=1a7abe6f1ff94b32a0e9a070532d0f80)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.708391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18398796-f7aa-4dd1-acef-0e0bdddb1a26 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.710134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 581/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/projects/1a7abe6f1ff94b32a0e9a070532d0f80 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:19.716765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.736283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.819581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fefea-dcaa-4431-8a8d-f7d1396ab510 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.854646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.855249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.855526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.855800 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.856519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] RBAC: Adding query filter params (role.id=340eacc70a83414ebbe72f2f23baeca1, scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80, user.id=627f7203bb334c30b2b2f61197c06bde) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:19.856851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.858274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bb0a2-d41e-42b8-b96d-c5fa78638a15 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.864149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 549/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/role_assignments?user.id=627f7203bb334c30b2b2f61197c06bde&scope.project.id=1a7abe6f1ff94b32a0e9a070532d0f80&role.id=340eacc70a83414ebbe72f2f23baeca1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:21.794028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc54ec-eebe-4b93-affe-b4a62aac7bec None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.794638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc54ec-eebe-4b93-affe-b4a62aac7bec None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.794638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc54ec-eebe-4b93-affe-b4a62aac7bec None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.796064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 582/1131] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:21.801896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.802460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.802460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.821345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:21.822594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:21.890287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 550/1132] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:22.166475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc54ec-eebe-4b93-affe-b4a62aac7bec None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:22.232233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:22.271756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc54ec-eebe-4b93-affe-b4a62aac7bec None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:22.305291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cad0a-88bc-41ae-8212-839ae0312175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:22.305952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cad0a-88bc-41ae-8212-839ae0312175 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.306265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cad0a-88bc-41ae-8212-839ae0312175 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.306575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cad0a-88bc-41ae-8212-839ae0312175 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.307749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cad0a-88bc-41ae-8212-839ae0312175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:22.309259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cad0a-88bc-41ae-8212-839ae0312175 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:22.310917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 583/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:22.317425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:22.329442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:22.417506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e7ff7-90a5-4888-afa9-db0e00470134 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:22.452153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9c47c-9838-4d2a-b9eb-4aa149224e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:22.452763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c47c-9838-4d2a-b9eb-4aa149224e49 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.453088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c47c-9838-4d2a-b9eb-4aa149224e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.453370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c47c-9838-4d2a-b9eb-4aa149224e49 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.454023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c47c-9838-4d2a-b9eb-4aa149224e49 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:22.455452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c47c-9838-4d2a-b9eb-4aa149224e49 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:22.585824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 551/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:22 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:24.528093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d024b2c-a4af-473c-8990-03b2115aa5e3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.528657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d024b2c-a4af-473c-8990-03b2115aa5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.528760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d024b2c-a4af-473c-8990-03b2115aa5e3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.530174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 584/1135] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:24.535985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.536392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.536752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.555908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:24.557232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:24.613447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:24.623606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 552/1136] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:24.893816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d024b2c-a4af-473c-8990-03b2115aa5e3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:25.009291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d024b2c-a4af-473c-8990-03b2115aa5e3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:25.039284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:25.044277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353be36-10c8-4817-a61f-67756206393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:25.044962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353be36-10c8-4817-a61f-67756206393f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:25.045287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353be36-10c8-4817-a61f-67756206393f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:25.045604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353be36-10c8-4817-a61f-67756206393f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:25.046774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353be36-10c8-4817-a61f-67756206393f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:25.048255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353be36-10c8-4817-a61f-67756206393f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:25.049979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 585/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:25.056467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:25.157235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79ba50-cb70-4053-bcab-f73612383850 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:25.190643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12595a0-c17b-4861-8f73-acffe7e60304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:25.191244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12595a0-c17b-4861-8f73-acffe7e60304 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:25.191526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12595a0-c17b-4861-8f73-acffe7e60304 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:25.191798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12595a0-c17b-4861-8f73-acffe7e60304 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:25.192444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12595a0-c17b-4861-8f73-acffe7e60304 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:25.193910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12595a0-c17b-4861-8f73-acffe7e60304 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:25.327622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 553/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:09:25 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:27.262482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e57bf-d55a-46a0-a0d1-e087b2ff5ad3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.263042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e57bf-d55a-46a0-a0d1-e087b2ff5ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.263160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e57bf-d55a-46a0-a0d1-e087b2ff5ad3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.264516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 586/1139] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:27.269726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.270147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.270274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.289229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:27.290495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:27.335270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:27.358266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 554/1140] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:27.628168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e57bf-d55a-46a0-a0d1-e087b2ff5ad3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.728852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e57bf-d55a-46a0-a0d1-e087b2ff5ad3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.762736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.763398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.763746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.764070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.774184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:27.779070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:27.780178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:27.781451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 587/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:27.786194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.884433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2996-1f9d-4b74-b28d-6ff7c0b1fea8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.916229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.916841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.917123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.917394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.918045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:27.918346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:27.919702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:27.927966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 555/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:27.933773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.991780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.030341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e373980-7eca-46fa-b3e3-dec3ead268a8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.063478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.064083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.064361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.065213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] PATH_INFO: `/v3/users/c7a2d5f885644ea681ceb56f4aaffd7e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.078536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] RBAC: Authorizing `identity:get_user(user_id=c7a2d5f885644ea681ceb56f4aaffd7e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.079960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.082142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 588/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/users/c7a2d5f885644ea681ceb56f4aaffd7e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:28.088038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.128504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.184016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1e697-6d03-4ae1-9ce9-2814765eb84c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.217035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.217635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.217910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.218184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.282580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.284047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.322818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.380228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 556/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:28.387809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.484632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49f1d5-0a42-4a52-9edd-a7d920283b8a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.501664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.518277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc8bb-ffe9-4869-a343-be5a9467d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.524769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc8bb-ffe9-4869-a343-be5a9467d881 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.524769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc8bb-ffe9-4869-a343-be5a9467d881 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.524769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc8bb-ffe9-4869-a343-be5a9467d881 None admin] PATH_INFO: `/v3/projects/731be2861e824bb79e53e31d0e738ff8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.524769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fc8bb-ffe9-4869-a343-be5a9467d881 None admin] RBAC: Authorizing `identity:get_project(project_id=731be2861e824bb79e53e31d0e738ff8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.524769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fc8bb-ffe9-4869-a343-be5a9467d881 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.524769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 589/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/projects/731be2861e824bb79e53e31d0e738ff8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:28.529739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.628638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249aa2e6-88f2-4644-a888-5abaec8b43a4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.661529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.662130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.662411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.662687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.663404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=731be2861e824bb79e53e31d0e738ff8, user.id=c7a2d5f885644ea681ceb56f4aaffd7e) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:28.663714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.665172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bee514-9d55-4da7-bb00-592c07c9adde None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.670486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 557/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/role_assignments?user.id=c7a2d5f885644ea681ceb56f4aaffd7e&scope.project.id=731be2861e824bb79e53e31d0e738ff8&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:30.550268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5eb6f-7a4e-4f4c-8082-e5acec9c9ad5 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:30.550677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5eb6f-7a4e-4f4c-8082-e5acec9c9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:30.550813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5eb6f-7a4e-4f4c-8082-e5acec9c9ad5 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:30.552156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 590/1147] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:30.557289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:30.557729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:30.557822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:30.565533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:30.576356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:30.582044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:30.645034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 558/1148] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:30.910810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5eb6f-7a4e-4f4c-8082-e5acec9c9ad5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.009910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5eb6f-7a4e-4f4c-8082-e5acec9c9ad5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.043788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.044408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.044692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.045002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.055435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:31.060160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:31.061359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:31.062617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 591/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:31.067407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.164873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c79491-d28b-40e6-9b1f-542231cd8175 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.199054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.199920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.200204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.200478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.201228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:31.201535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.202898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.204230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.211257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 559/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:31.217326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.263835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.315742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142dba9-afa3-4f9f-be28-26eb63d45733 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.348564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.349203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.349484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.349755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] PATH_INFO: `/v3/users/c7a2d5f885644ea681ceb56f4aaffd7e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.350847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] RBAC: Authorizing `identity:get_user(user_id=c7a2d5f885644ea681ceb56f4aaffd7e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.352270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.353961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 592/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/users/c7a2d5f885644ea681ceb56f4aaffd7e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:31.359733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.456789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d5b5-a3d9-4338-b777-380aca1c87da None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.488930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978082c-c48b-40ce-85cd-8bdd0e84ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.489547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978082c-c48b-40ce-85cd-8bdd0e84ee1b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.489827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978082c-c48b-40ce-85cd-8bdd0e84ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.490099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978082c-c48b-40ce-85cd-8bdd0e84ee1b None admin] PATH_INFO: `/v3/projects/731be2861e824bb79e53e31d0e738ff8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.491198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978082c-c48b-40ce-85cd-8bdd0e84ee1b None admin] RBAC: Authorizing `identity:get_project(project_id=731be2861e824bb79e53e31d0e738ff8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.492616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978082c-c48b-40ce-85cd-8bdd0e84ee1b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.494255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 560/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/projects/731be2861e824bb79e53e31d0e738ff8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:31.500188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.599789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fd4a-d363-460a-ae1e-a294843ea311 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.614233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.633704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07424b7-50ad-4a11-9f78-a1b28bbd2bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.634435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07424b7-50ad-4a11-9f78-a1b28bbd2bbf None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.634711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07424b7-50ad-4a11-9f78-a1b28bbd2bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.634987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07424b7-50ad-4a11-9f78-a1b28bbd2bbf None admin] PATH_INFO: `/v3/projects/731be2861e824bb79e53e31d0e738ff8/users/c7a2d5f885644ea681ceb56f4aaffd7e/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.636881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07424b7-50ad-4a11-9f78-a1b28bbd2bbf None admin] RBAC: Authorizing `identity:create_grant(project_id=731be2861e824bb79e53e31d0e738ff8, user_id=c7a2d5f885644ea681ceb56f4aaffd7e, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.638297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07424b7-50ad-4a11-9f78-a1b28bbd2bbf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.720687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 593/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:31 2022] PUT /identity/v3/projects/731be2861e824bb79e53e31d0e738ff8/users/c7a2d5f885644ea681ceb56f4aaffd7e/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:33.596923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da55fb4-1e8d-4136-b636-eab6ee1a949d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.597442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da55fb4-1e8d-4136-b636-eab6ee1a949d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.597565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da55fb4-1e8d-4136-b636-eab6ee1a949d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.598832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 561/1154] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:33.604211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.604663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.604755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.623270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:33.624463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:33.689074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 594/1155] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:33.962225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da55fb4-1e8d-4136-b636-eab6ee1a949d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.024534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.061382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da55fb4-1e8d-4136-b636-eab6ee1a949d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.094687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.095297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.095578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.095877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.106005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:34.110733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:34.114207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:34.115225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 562/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:34.117822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.219764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd0b3c-037b-41db-a349-4df1820a87fd None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.222001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.252445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.253074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.253351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.253620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.254274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:34.254576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.255925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.263756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 595/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:34.269961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.367928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321fe4d-be56-48b3-988b-ad42ae43982e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.390660 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.401068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.401693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.401977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.402253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] PATH_INFO: `/v3/users/c7a2d5f885644ea681ceb56f4aaffd7e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.403357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] RBAC: Authorizing `identity:get_user(user_id=c7a2d5f885644ea681ceb56f4aaffd7e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.404864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.406441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 563/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/users/c7a2d5f885644ea681ceb56f4aaffd7e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:34.412450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.510361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240344e-6e34-40c9-868a-2ec1358ecb68 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.542696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.543306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.543690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.543972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.577852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.610277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.612301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.712466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 596/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:34.718698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.817074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ce8e-abd1-40dc-9ccd-dde14b92b827 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.849851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718db44-78bc-4bdf-b08c-55e41123fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.850470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718db44-78bc-4bdf-b08c-55e41123fa33 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.850755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718db44-78bc-4bdf-b08c-55e41123fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.851033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718db44-78bc-4bdf-b08c-55e41123fa33 None admin] PATH_INFO: `/v3/projects/731be2861e824bb79e53e31d0e738ff8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.852147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718db44-78bc-4bdf-b08c-55e41123fa33 None admin] RBAC: Authorizing `identity:get_project(project_id=731be2861e824bb79e53e31d0e738ff8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.853648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718db44-78bc-4bdf-b08c-55e41123fa33 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.855258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 564/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/projects/731be2861e824bb79e53e31d0e738ff8 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:34.861361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.923471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.956591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf01c2-0e70-4948-a68c-c3f94654dad1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.991038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.991640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.991918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.992197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.992944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=731be2861e824bb79e53e31d0e738ff8, user.id=c7a2d5f885644ea681ceb56f4aaffd7e) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:34.993261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.994670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0a5f8-e368-41c3-a1ff-d3177324d04d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:35.000253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 597/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/role_assignments?user.id=c7a2d5f885644ea681ceb56f4aaffd7e&scope.project.id=731be2861e824bb79e53e31d0e738ff8&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:36.915085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8472b-ed4e-4171-b778-d1deb0c3ac35 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.915620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8472b-ed4e-4171-b778-d1deb0c3ac35 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.915620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8472b-ed4e-4171-b778-d1deb0c3ac35 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.917013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 565/1162] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:36.922225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.922631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.922786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.940712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:36.941947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:37.008087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 598/1163] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:37.275427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8472b-ed4e-4171-b778-d1deb0c3ac35 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.333783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.373740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8472b-ed4e-4171-b778-d1deb0c3ac35 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.406303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.406929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.407201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.407471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.474860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.476287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.534416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.575711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 566/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:37.581559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.641584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.681216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662cdb-609e-4948-9fea-f8f89d35257e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.715359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.715979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.716259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.716532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.723628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.725090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-44bb2e00-0983-483b-9784-c20d18d6b9e8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:37.736123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:37.737300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:37.738577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 599/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:37.743310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.840953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f885db-8f28-4685-99cb-3b6a732ff0f7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.873471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.874063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.874343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.874614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.875247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:37.875548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.877433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc854e-70bf-48a3-9b05-52a32d40a359 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.884249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 567/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:39.745083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9d035-33da-4548-a7a2-78578eded656 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:39.745631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9d035-33da-4548-a7a2-78578eded656 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:39.745631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9d035-33da-4548-a7a2-78578eded656 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:39.747049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 600/1167] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:39.753127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694be8-c0a2-44b3-9386-9e9b2092a262 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:39.753540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694be8-c0a2-44b3-9386-9e9b2092a262 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:39.753677 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694be8-c0a2-44b3-9386-9e9b2092a262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:39.771545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bb694be8-c0a2-44b3-9386-9e9b2092a262 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:39.772730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bb694be8-c0a2-44b3-9386-9e9b2092a262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:39.789423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:39.837372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 568/1168] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:40.111670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9d035-33da-4548-a7a2-78578eded656 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:40.213487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9d035-33da-4548-a7a2-78578eded656 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:40.233565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:40.247491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4fb6-2cbe-4fe0-a286-3062123b2f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:40.248122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4fb6-2cbe-4fe0-a286-3062123b2f86 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:40.248402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4fb6-2cbe-4fe0-a286-3062123b2f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:40.248671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4fb6-2cbe-4fe0-a286-3062123b2f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:40.249356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4fb6-2cbe-4fe0-a286-3062123b2f86 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:40.250743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4fb6-2cbe-4fe0-a286-3062123b2f86 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:40.344451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 601/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Wed Aug 31 19:09:40 2022] POST /identity/v3/domains => generated 267 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:42.271912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536e11a-ff53-473b-944d-5a4651fba236 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:42.272450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536e11a-ff53-473b-944d-5a4651fba236 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:42.272450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536e11a-ff53-473b-944d-5a4651fba236 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:42.273873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 569/1170] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:42.279189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:42.279597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:42.279736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:42.297992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:42.299787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:42.364568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 602/1171] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:42.629999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536e11a-ff53-473b-944d-5a4651fba236 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:42.731865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536e11a-ff53-473b-944d-5a4651fba236 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:42.764085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202abb24-ab48-43f2-adbf-96d46e59b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:42.764708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202abb24-ab48-43f2-adbf-96d46e59b9dc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:42.765029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202abb24-ab48-43f2-adbf-96d46e59b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:42.765317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202abb24-ab48-43f2-adbf-96d46e59b9dc None admin] PATH_INFO: `/v3/domains/fb495a1b2e694bc595e2311bc28a2473` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:42.775966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202abb24-ab48-43f2-adbf-96d46e59b9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=fb495a1b2e694bc595e2311bc28a2473)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:42.777474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202abb24-ab48-43f2-adbf-96d46e59b9dc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:42.779044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 570/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Wed Aug 31 19:09:42 2022] GET /identity/v3/domains/fb495a1b2e694bc595e2311bc28a2473 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:42.785655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:42.879765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d7ca-48c4-44b5-a10f-0220cd429938 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:42.889950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:42.914065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced223-c9fe-4a3c-b05f-e6e00f59c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:42.914680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced223-c9fe-4a3c-b05f-e6e00f59c358 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:42.915054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced223-c9fe-4a3c-b05f-e6e00f59c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:42.915237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced223-c9fe-4a3c-b05f-e6e00f59c358 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:42.915887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced223-c9fe-4a3c-b05f-e6e00f59c358 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:42.917367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced223-c9fe-4a3c-b05f-e6e00f59c358 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:43.024488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 603/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:42 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:44.957754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758df1-ce1a-4c7c-869b-02a413ba4000 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:44.958325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758df1-ce1a-4c7c-869b-02a413ba4000 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:44.958325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758df1-ce1a-4c7c-869b-02a413ba4000 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:44.959669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 571/1174] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:44.965057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a611e-17cc-49aa-827d-8f178991255b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:44.965487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a611e-17cc-49aa-827d-8f178991255b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:44.965603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a611e-17cc-49aa-827d-8f178991255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:44.984248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-221a611e-17cc-49aa-827d-8f178991255b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:44.985787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-221a611e-17cc-49aa-827d-8f178991255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:45.052268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 604/1175] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:45.317901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef758df1-ce1a-4c7c-869b-02a413ba4000 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:45.334663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:45.419345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef758df1-ce1a-4c7c-869b-02a413ba4000 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:45.451990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0f0e-8fa1-4490-96cb-9a8da49b0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:45.452613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0f0e-8fa1-4490-96cb-9a8da49b0e81 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:45.452924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0f0e-8fa1-4490-96cb-9a8da49b0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:45.453202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0f0e-8fa1-4490-96cb-9a8da49b0e81 None admin] PATH_INFO: `/v3/domains/fb495a1b2e694bc595e2311bc28a2473` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:45.454302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b0f0e-8fa1-4490-96cb-9a8da49b0e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fb495a1b2e694bc595e2311bc28a2473)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:45.455767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b0f0e-8fa1-4490-96cb-9a8da49b0e81 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:45.457359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 572/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Wed Aug 31 19:09:45 2022] GET /identity/v3/domains/fb495a1b2e694bc595e2311bc28a2473 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:45.463165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a611e-17cc-49aa-827d-8f178991255b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:45.556976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:45.565853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a611e-17cc-49aa-827d-8f178991255b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:45.601297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526346ba-b4e1-474a-b9a9-810c5e9bc097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:45.601830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526346ba-b4e1-474a-b9a9-810c5e9bc097 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:45.602111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526346ba-b4e1-474a-b9a9-810c5e9bc097 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:45.602386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526346ba-b4e1-474a-b9a9-810c5e9bc097 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:45.603041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526346ba-b4e1-474a-b9a9-810c5e9bc097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:45.604468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526346ba-b4e1-474a-b9a9-810c5e9bc097 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:45.760830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 605/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:09:45 2022] POST /identity/v3/users => generated 311 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:47.709162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675fea8-3ea6-4e6b-bf66-f350f3695622 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:47.709737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675fea8-3ea6-4e6b-bf66-f350f3695622 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:47.709737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675fea8-3ea6-4e6b-bf66-f350f3695622 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:47.711082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 573/1178] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:47.716223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:47.716669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:47.716762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:47.735284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:47.737119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:47.803305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 606/1179] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:48.085278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675fea8-3ea6-4e6b-bf66-f350f3695622 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:48.172743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:48.192315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675fea8-3ea6-4e6b-bf66-f350f3695622 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:48.225445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:48.226067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.226466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.226817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.237887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:48.242780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:48.243857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:48.244888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 574/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:48.250382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:48.327446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:48.351454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399529b-a51e-46fc-be21-bc466280ab87 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:48.382959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:48.383569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.383856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.384135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.384844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:48.385143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:48.386562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:48.395092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 607/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:48.401122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:48.498420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317048c8-e217-4efa-8468-c12492d61630 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:48.532201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:48.532824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.533124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.533396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] PATH_INFO: `/v3/users/002f422e411f4609a97f00b98e7d7762` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.544620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:48.547008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] RBAC: Authorizing `identity:get_user(user_id=002f422e411f4609a97f00b98e7d7762)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:48.548468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:48.550152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 575/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/users/002f422e411f4609a97f00b98e7d7762 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:48.556072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:48.653117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3336c3-f403-4bf7-95e2-3e0af9a04b1c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:48.685367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:48.685957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.686237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.686522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.697182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:48.751603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:48.753075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:48.847936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 608/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:48.853906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:48.949999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821ef2a-9480-4795-83eb-38d476668399 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:48.982889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6e610-cb87-487f-9f74-16d3b07340fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:48.983499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6e610-cb87-487f-9f74-16d3b07340fb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.983776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6e610-cb87-487f-9f74-16d3b07340fb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.984048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6e610-cb87-487f-9f74-16d3b07340fb None admin] PATH_INFO: `/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.985165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6e610-cb87-487f-9f74-16d3b07340fb None admin] RBAC: Authorizing `identity:get_project(project_id=b1ef03aa221d4d27b1ebdd785260c7d7)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:48.986624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6e610-cb87-487f-9f74-16d3b07340fb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:48.988211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 576/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:48.994428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:49.034861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:49.090258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb805-f7c7-45a1-bb30-0dee6d13c24c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:49.123773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:49.124363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:49.124642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:49.124943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:49.125665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=b1ef03aa221d4d27b1ebdd785260c7d7, user.id=002f422e411f4609a97f00b98e7d7762) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:49.125970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:49.127413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8554c6-a613-420d-b052-bafbd2627c09 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:49.132563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 609/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/role_assignments?user.id=002f422e411f4609a97f00b98e7d7762&scope.project.id=b1ef03aa221d4d27b1ebdd785260c7d7&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:51.038998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3191f0-7d3d-479f-b108-a6366f29bef0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.039586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3191f0-7d3d-479f-b108-a6366f29bef0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.039586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3191f0-7d3d-479f-b108-a6366f29bef0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.040950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 577/1186] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:51.046382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.046819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.046949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.065627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:51.066816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:51.133160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 610/1187] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:51.407807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3191f0-7d3d-479f-b108-a6366f29bef0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:51.476435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.510294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3191f0-7d3d-479f-b108-a6366f29bef0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:51.547241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:51.547613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.547931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.548249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.558486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:51.563223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:51.568908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:09:51.570165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 578/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:51.571096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:51.605171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.670626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51f06-ff03-4506-8905-96a8e12027de None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:51.703379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:51.703981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.704790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.705099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.705762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:51.706070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:51.707435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:51.717701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 611/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:51.725298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:51.825358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d47739-695a-4507-a539-8d88e64c9cea None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:51.852822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.860540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:51.861218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.861504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.861782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] PATH_INFO: `/v3/users/002f422e411f4609a97f00b98e7d7762` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.862949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] RBAC: Authorizing `identity:get_user(user_id=002f422e411f4609a97f00b98e7d7762)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:51.864512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:51.866125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 579/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:51 2022] GET /identity/v3/users/002f422e411f4609a97f00b98e7d7762 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:51.872137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:51.965446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.971704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0bde4-cf5b-4c6c-a9da-9a9f56ab9a2d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:52.005098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dec1a5-0364-405f-b506-0e5e2490c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:52.005725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dec1a5-0364-405f-b506-0e5e2490c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:52.006008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dec1a5-0364-405f-b506-0e5e2490c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:52.006285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dec1a5-0364-405f-b506-0e5e2490c3a8 None admin] PATH_INFO: `/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:52.007399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dec1a5-0364-405f-b506-0e5e2490c3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b1ef03aa221d4d27b1ebdd785260c7d7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:52.008928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dec1a5-0364-405f-b506-0e5e2490c3a8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:52.010578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 612/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:51 2022] GET /identity/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:52.016669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:52.116909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a3135-5b8d-412d-a3a9-5c69ccdbacbf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:52.150693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be265f4-9fe0-4c1b-8355-e7f9793ae818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:52.151420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be265f4-9fe0-4c1b-8355-e7f9793ae818 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:52.151690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be265f4-9fe0-4c1b-8355-e7f9793ae818 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:52.151955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be265f4-9fe0-4c1b-8355-e7f9793ae818 None admin] PATH_INFO: `/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7/users/002f422e411f4609a97f00b98e7d7762/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:52.153845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be265f4-9fe0-4c1b-8355-e7f9793ae818 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1ef03aa221d4d27b1ebdd785260c7d7, user_id=002f422e411f4609a97f00b98e7d7762, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:52.155262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be265f4-9fe0-4c1b-8355-e7f9793ae818 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:52.239801 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 580/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:52 2022] PUT /identity/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7/users/002f422e411f4609a97f00b98e7d7762/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:54.133263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ff74-924c-43fe-9de2-a4354bbeb2b0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.133908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ff74-924c-43fe-9de2-a4354bbeb2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.133908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ff74-924c-43fe-9de2-a4354bbeb2b0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.135159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 613/1193] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:54.140412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.140855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.140989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.159695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:54.160907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:54.212438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:54.228954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 581/1194] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:54.504835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ff74-924c-43fe-9de2-a4354bbeb2b0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:54.607426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ff74-924c-43fe-9de2-a4354bbeb2b0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:54.640789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:54.641442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.642282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.642563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.653163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:54.658598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:54.659794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:09:54.660839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 614/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:54.665981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:54.762244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f458597-fbb0-4cfb-8cca-7f332d79f562 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:54.796218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:54.796838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.797121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.797394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.798091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:54.798396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:54.799769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:54.807631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 582/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:54.813653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:54.839594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:54.913310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf54b3-0368-46dd-9384-ea3d133402f6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:54.945806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:54.946545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.946837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.947117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] PATH_INFO: `/v3/users/002f422e411f4609a97f00b98e7d7762` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.948251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] RBAC: Authorizing `identity:get_user(user_id=002f422e411f4609a97f00b98e7d7762)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:54.949985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:54.951581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 615/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:54 2022] GET /identity/v3/users/002f422e411f4609a97f00b98e7d7762 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:54.958070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:55.007213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:55.057984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c56c-63d7-4b6f-a1d5-92c79d39bcb3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:55.090898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:55.091496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:55.091773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:55.092044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:55.160849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:55.162332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:55.209857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:55.261306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 583/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:55.267512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:55.358191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:55.367059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938d00-5b1b-41f7-8572-78f0b79f553e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:55.400190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b121-fa6a-4bcd-8419-6cae684b3e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:55.400826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b121-fa6a-4bcd-8419-6cae684b3e95 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:55.401105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b121-fa6a-4bcd-8419-6cae684b3e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:55.401376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b121-fa6a-4bcd-8419-6cae684b3e95 None admin] PATH_INFO: `/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:55.402499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880b121-fa6a-4bcd-8419-6cae684b3e95 None admin] RBAC: Authorizing `identity:get_project(project_id=b1ef03aa221d4d27b1ebdd785260c7d7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:55.403922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880b121-fa6a-4bcd-8419-6cae684b3e95 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:55.406136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 616/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:55 2022] GET /identity/v3/projects/b1ef03aa221d4d27b1ebdd785260c7d7 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:55.412463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:55.510587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980dd7-7c08-46ae-8e41-3d03b47bbe25 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:55.546790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:55.547404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:55.547680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:55.547952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:55.548685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=b1ef03aa221d4d27b1ebdd785260c7d7, user.id=002f422e411f4609a97f00b98e7d7762) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:55.549028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:55.550485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee23ab-b359-4c4e-89d0-e4c468cf1a3e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:55.556376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 584/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:55 2022] GET /identity/v3/role_assignments?user.id=002f422e411f4609a97f00b98e7d7762&scope.project.id=b1ef03aa221d4d27b1ebdd785260c7d7&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:05.407923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=20 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.553717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:14.248046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591129-489d-4864-b2da-73e579d1da73 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:14.248671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591129-489d-4864-b2da-73e579d1da73 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:14.248671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591129-489d-4864-b2da-73e579d1da73 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:14.249987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 617/1201] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:11:14.255234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:14.255626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:14.255780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:14.274293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:14.276795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:14.343257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 585/1202] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:14.616910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f591129-489d-4864-b2da-73e579d1da73 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:14.718623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f591129-489d-4864-b2da-73e579d1da73 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:14.751957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:14.752584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:14.752891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:14.753165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:14.763887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:14.765363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:14.779153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:14.782180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:14.783318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:14.783318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:14.783318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:14.783318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 618/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:14.786508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:14.898527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe072b-8e8b-410e-adab-b7949676ba06 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:14.927048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:14.932661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:14.933302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:14.933587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:14.933865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:14.934505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:14.934837 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:14.936251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012d79-f21d-4e85-b178-5b766d986efd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:14.947387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 586/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:14.953784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:15.006361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:15.052830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8ccea-e053-4dc7-aa37-9cad9b8e8ae0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:15.086252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d70e76-ea0a-45ce-95ce-ef12ee85fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:15.086853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d70e76-ea0a-45ce-95ce-ef12ee85fcf0 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:15.087134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d70e76-ea0a-45ce-95ce-ef12ee85fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:15.087417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d70e76-ea0a-45ce-95ce-ef12ee85fcf0 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:15.088067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d70e76-ea0a-45ce-95ce-ef12ee85fcf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:15.089562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d70e76-ea0a-45ce-95ce-ef12ee85fcf0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:15.184858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 619/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Wed Aug 31 19:11:14 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:11:17.181682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d08d-37b4-4df4-84f3-8d962338393b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:17.182251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d08d-37b4-4df4-84f3-8d962338393b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:17.182251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d08d-37b4-4df4-84f3-8d962338393b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:17.183593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 587/1206] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:17.189036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:17.189474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:17.189581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:17.209162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:17.213499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:17.280570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 620/1207] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:17.552998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d08d-37b4-4df4-84f3-8d962338393b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:17.660124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d08d-37b4-4df4-84f3-8d962338393b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:17.693600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:17.697436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:17.697436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:17.697436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:17.705842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:17.710643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:17.711750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:17.712855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 588/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:17.718418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:17.756611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:17.814028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951f8a4-7d44-417f-9d88-7760fbc263f3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:17.847412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:17.848022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:17.848302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:17.848575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:17.849272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:17.849577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:17.850941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:17.859374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 621/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:17.865273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:17.915189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:17.964587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4222312-3ca6-4654-b2da-902887b1a989 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:17.997344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:17.998002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:17.998320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:17.998592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.008890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:18.010331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:18.024614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:18.029877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:18.030965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:18.030965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:18.030965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:18.030965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 589/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:18.032214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:18.126104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:18.129025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cd6fa-f059-4996-a7fa-4613ebb0ba3f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:18.162488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:18.163091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.163378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.163652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.164287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:18.164655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:18.166048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:18.178026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 622/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:18.185074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:18.285856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326023-c24d-4a8b-ad43-c5fd8f1540cb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:18.288433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:18.321499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:18.322158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.322443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.322745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.331884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:18.333460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:18.345100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:18.346263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:18.347629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 590/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:11:18.352174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:18.455244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d4db0-a3c5-4257-a936-4ffd59eea75e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:18.488315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:18.488952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.489237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.489514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.490234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:18.490541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:18.491958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:18.509140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 623/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:18.515791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:18.617048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fef42-00e2-4f92-ad28-6004fb847f32 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:18.650684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:18.651287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.651571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.651847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.681120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:18.718498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:18.719875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:18.816160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 591/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:11:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:11:18.822320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:18.841177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:18.922546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295e42f-f88d-4178-84ce-299ac369eea6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:18.958111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:18.964684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.964684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.964684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.969873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:18.971257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:18.985920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:18.987010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:18.988241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:18.988241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:18.988241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:18.988241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 624/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:18.992832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:19.055278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:19.095524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916628a7-61aa-4b25-b7f2-317dbc21ebc7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:19.128934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:19.129544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:19.129822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:19.130089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:19.130725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:19.131032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:19.132485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:19.144485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 592/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:19.150245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:19.220093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:19.251244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a92c-08e3-4304-8235-507ea902284e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:19.284413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:19.285061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:19.285347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:19.285623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:19.292710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:19.294200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:19.305359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:19.306454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:19.307408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 625/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:19.313277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:19.414593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23401-ce9f-440f-ae2c-d893f419cc50 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:19.439449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:19.450938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:19.451542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:19.451819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:19.452089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:19.452769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:19.453118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:19.454545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c94b8-dcdb-459a-b2b7-0f29b9e76b23 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:19.469471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 593/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:19.475854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:19.577574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c33dc-52c1-490a-b9cb-0f4ba1524ca6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:19.605444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:19.611660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:19.612267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:19.612552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:19.612858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:19.613588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=79c69df95a434fdeb5737455ba226320) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:19.613956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:19.615346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb1a3-313c-417c-9813-cbdd3127739b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:19.621312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 626/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:11:19 2022] GET /identity/v3/role_assignments?user.id=79c69df95a434fdeb5737455ba226320&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:21.543232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367bd3-d05a-4000-bb8f-149e218668c6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:21.543793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367bd3-d05a-4000-bb8f-149e218668c6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:21.543793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367bd3-d05a-4000-bb8f-149e218668c6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:21.545807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 594/1220] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:21.550967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:21.551362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:21.551523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:21.570484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:21.574059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:21.638559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 627/1221] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:21.914698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39367bd3-d05a-4000-bb8f-149e218668c6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.020111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39367bd3-d05a-4000-bb8f-149e218668c6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:22.064400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:22.065061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.065351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.065674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.076516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:22.081346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:22.082339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:22.083258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 595/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:22.088594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.185903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2977734-d72f-49a4-8c5c-83269004a7e5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:22.209379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:22.219711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:22.220323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.220605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.220905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.221569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:22.221906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:22.223269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:22.231552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 628/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:11:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:22.238925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.281424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:22.336975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23307f-f1cd-4b7f-8d6a-0849fdf02592 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:22.370654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:22.371269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.371548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.371816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.383209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:22.384816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:22.400582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:22.408534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:22.409715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:22.409715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:22.409715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:22.409715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 596/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:22.410049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.509497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde252-7034-4b16-bfb8-5214193e0780 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:22.542482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:22.543098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.543380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.543654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.545375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:22.545375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:22.546541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:22.558419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 629/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:22.564789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.657939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:22.665355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8297-257e-4d49-a171-7b952d1d6cf1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:22.705080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:22.705753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.706032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.706306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.713775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:22.715240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:22.727534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:22.728560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:22.729916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 597/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:22.735633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.782465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:22.834512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99043-9ca5-452a-ae76-ac9b43d770a0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:22.866371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:22.866966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.867248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.867525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.868246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:22.868553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:22.870226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:22.887216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 630/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:22.893639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:22.991980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ae38b-925b-4ae9-9d89-bbd300bfc780 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:23.025644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:23.026274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:23.026663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:23.026943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.047214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:23.047214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:23.053897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:23.055029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:23.056379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:23.056379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:23.056379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:23.056379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 598/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:23.061588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:23.163290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1278c-7b2d-470d-82f4-9d77eb33eff6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:23.166081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:23.202607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794d76-8737-4738-8546-6b552cac073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:23.203222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794d76-8737-4738-8546-6b552cac073f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:23.203505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794d76-8737-4738-8546-6b552cac073f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:23.203786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794d76-8737-4738-8546-6b552cac073f None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.204434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794d76-8737-4738-8546-6b552cac073f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:23.204733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794d76-8737-4738-8546-6b552cac073f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:23.206135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794d76-8737-4738-8546-6b552cac073f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:23.217685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 631/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:23.223786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:23.234662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:23.329052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6111baa-38cd-457b-9272-77e17254f300 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:23.363254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:23.363890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:23.364169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:23.364446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.373058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:23.374117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:23.386259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:23.387275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:23.388487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 599/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:23.392875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794d76-8737-4738-8546-6b552cac073f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:23.498746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794d76-8737-4738-8546-6b552cac073f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:23.530998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:23.531591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:23.531868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:23.532137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.532845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:23.533148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:23.534554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cd4ff-5dc4-4cdc-9515-a859dac219ff None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:23.548397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 632/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:23.554734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:23.626301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:23.661106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0509fd-1d6b-404a-9978-16f7175c086c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:23.695006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac557-b54c-42ea-a9fe-063f1f1361c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:23.695663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac557-b54c-42ea-a9fe-063f1f1361c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:23.696214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac557-b54c-42ea-a9fe-063f1f1361c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:23.696488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac557-b54c-42ea-a9fe-063f1f1361c4 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/79c69df95a434fdeb5737455ba226320/roles/a6bfc070c9dc4efa898c6106bf90e482` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.710960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ac557-b54c-42ea-a9fe-063f1f1361c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=79c69df95a434fdeb5737455ba226320, role_id=a6bfc070c9dc4efa898c6106bf90e482)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:23.712390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ac557-b54c-42ea-a9fe-063f1f1361c4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:23.775036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 600/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:11:23 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/79c69df95a434fdeb5737455ba226320/roles/a6bfc070c9dc4efa898c6106bf90e482 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:11:25.719295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fccb1-1c7a-4ec3-bf66-b01d4d6841d2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:25.719833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fccb1-1c7a-4ec3-bf66-b01d4d6841d2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:25.719833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fccb1-1c7a-4ec3-bf66-b01d4d6841d2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:25.721363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 633/1233] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:25.726758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:25.727190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:25.727316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:25.745540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:25.754505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:25.813852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 601/1234] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:26.086321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fccb1-1c7a-4ec3-bf66-b01d4d6841d2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:26.112603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.190249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fccb1-1c7a-4ec3-bf66-b01d4d6841d2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:26.227062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:26.234673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.234673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.234673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.238225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:26.242954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:26.244107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:26.245530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 634/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:26.250688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:26.297687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.350711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432111-5fd2-4438-a577-7bb86d82366e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:26.383466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:26.384076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.384361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.384637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.385337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:26.385645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:26.387029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:26.395400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 602/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:11:26.401320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:26.488578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.504565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0761b-fb05-4ab5-9798-768d5479b1d2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:26.544872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:26.545010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.545221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.545503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.556007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:26.557527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:26.572727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:26.577575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:26.578498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:26.578498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:26.578498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:26.578498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 635/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:26.580477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:26.681413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c731-c8f8-46f7-a494-4dec8619457a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:26.691533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.722215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:26.722827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.723154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.723430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.724074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:26.724379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:26.725786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:26.738768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 603/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:26.744507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:26.845159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619d36b-bfe9-4fff-8f92-a72663963c9d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:26.878719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:26.879355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.879677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.879894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.882678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.887972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:26.889459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:26.900281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:26.907031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:26.908181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 636/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:26.908929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.007072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d9a0-3f1f-45ec-a2af-735be8737988 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:27.040899 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf366c6-725e-486a-8732-c200789768ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:27.041507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf366c6-725e-486a-8732-c200789768ff None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.041788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf366c6-725e-486a-8732-c200789768ff None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.042062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf366c6-725e-486a-8732-c200789768ff None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.042842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf366c6-725e-486a-8732-c200789768ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:27.043151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf366c6-725e-486a-8732-c200789768ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:27.045101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf366c6-725e-486a-8732-c200789768ff None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:27.065229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 604/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:27.068686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.171207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09126f-2f86-4c9d-8aae-b898d6606137 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:27.206681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:27.207293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.207595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.207887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.276105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:27.282520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:27.284077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:27.383438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 637/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:11:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:11:27.389851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf366c6-725e-486a-8732-c200789768ff None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.417686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:27.490489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf366c6-725e-486a-8732-c200789768ff None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:27.524690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:27.525337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.525614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.525884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.536404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:27.537908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:27.553065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:27.554249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:27.555195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:27.555195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:27.555195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:27.555195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 605/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:11:27.560445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.654310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:27.659979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b145-b4cd-4a38-b836-65ad47737f97 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:27.693526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:27.694167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.694490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.694763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.695396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:27.695963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:27.697356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:27.708314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 638/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:27.714029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.794689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:27.816169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9115-8084-4651-ab26-5a53d951ed01 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:27.849132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:27.849798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.850081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.850355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.857434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:27.858941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:27.869772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:27.870826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:27.871920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 606/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:27.877531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.974932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062a4ef-14da-4da8-bc35-11c1717491e3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:28.008594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:28.009233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:28.009518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:28.009797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:28.010490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:28.010798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:28.012227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee1a4f-19a6-4f89-a1b2-4dfc9888b252 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:28.025070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 639/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:28.031664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:28.134058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34d21a-d057-4f78-aeea-8033c1b956c6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:28.167303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:28.167906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:28.168188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:28.168493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:28.169813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] RBAC: Adding query filter params (role.id=a6bfc070c9dc4efa898c6106bf90e482, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=79c69df95a434fdeb5737455ba226320) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:28.170126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:28.171549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447186b9-0cdf-4887-b197-739512167c83 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:28.177275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 607/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:11:28 2022] GET /identity/v3/role_assignments?user.id=79c69df95a434fdeb5737455ba226320&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a6bfc070c9dc4efa898c6106bf90e482 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:30.177823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bf083-6b27-4319-b2ce-98bf4ed63eb2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.178398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bf083-6b27-4319-b2ce-98bf4ed63eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.178398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bf083-6b27-4319-b2ce-98bf4ed63eb2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.179706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 640/1247] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:30.185742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.186169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.186277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.192576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:30.205949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:30.212728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:30.275240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 608/1248] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:30.542393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bf083-6b27-4319-b2ce-98bf4ed63eb2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:30.563008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:30.644207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bf083-6b27-4319-b2ce-98bf4ed63eb2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:30.677827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:30.678447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.678725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.678997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.688932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:30.693613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:30.694724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:30.696150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 641/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:30.701444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:30.798845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff72bd-3fc8-4d6d-bf98-d89c42554ceb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:30.828622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:30.833341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:30.834587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.834587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.834587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.835175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:30.835472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:30.836856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:30.845497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 609/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:11:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:30.851183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:30.928349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:30.951439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0df37-b75a-480a-bc33-65bcd738337e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:30.984383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:30.985033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.985312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.985577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.995663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.000896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:31.011321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:31.012445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:31.014117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:31.014117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:31.014117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:31.014117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 642/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:31.018932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:31.118738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526ccc9-3697-44e5-9096-ee12bea364bb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:31.152411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:31.153036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:31.153344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:31.153617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:31.154249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:31.154547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.155939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.167541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 610/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:31.173335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:31.277118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f0e3-b2c1-4e81-bc78-2bc4edb9f941 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:31.305163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:31.313557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:31.314221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:31.314507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:31.314786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:31.322775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.328091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:31.336567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:31.337696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:31.338827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 643/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:31.343980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:31.399264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:31.443964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30684c30-4402-4576-83b9-9e59d3c7d512 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:31.478115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:31.478723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:31.479007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:31.479280 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:31.480038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:31.480370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.482426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.500586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 611/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:31.506541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:31.609168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5e11-9a09-4f37-b685-92fb586af9eb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:31.643502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:31.644113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:31.644393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:31.644671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:31.701055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:31.713253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.714715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.813803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 644/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:11:31.819844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:31.920718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170f8f-162a-43c3-a542-f13d6b4da440 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:31.933613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:31.954938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:31.955493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:31.955772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:31.956041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:31.965539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.966970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:31.981928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:31.986044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:31.987119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:31.987119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:31.987119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:31.987119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 612/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:31.988987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:32.076228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:32.087642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535c4f-5f3e-484e-a0c1-125108e50518 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:32.120906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:32.121507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.121783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.122683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.123326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:32.123641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:32.125025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:32.136388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 645/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:32.142170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:32.243316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf11fc-7362-4567-b93c-dd416fa3ec19 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:32.281923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:32.282541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.282829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.283131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.291098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:32.291674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:32.306068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:32.309898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:32.311021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 613/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:32.313403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:32.412885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dae20-f5a6-415d-85c8-192e93e51422 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:32.446063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:32.446663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.446940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.447211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.447892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:32.448197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:32.449635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede41fd-5e63-4fd5-8eaf-e1cee2e0ae9b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:32.461897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 646/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:32.468709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:32.494661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:32.567502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5a28-e66c-48d9-8230-61452d099bc7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:32.601327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:32.601922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.602200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.602473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.603184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=79c69df95a434fdeb5737455ba226320) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:32.603486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:32.604924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d884a-e201-4199-9bac-1d80201f5c8c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:32.610721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 614/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:11:32 2022] GET /identity/v3/role_assignments?user.id=79c69df95a434fdeb5737455ba226320&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a3733baec72d443ab044f15928e9f85d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:34.479785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b18ab-dfcd-445e-9254-b2952f35dceb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:34.480347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b18ab-dfcd-445e-9254-b2952f35dceb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:34.480347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b18ab-dfcd-445e-9254-b2952f35dceb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:34.482309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 647/1261] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:34.487446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:34.487864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:34.487976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:34.508369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:34.509665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:34.577973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 615/1262] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:34.842974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b18ab-dfcd-445e-9254-b2952f35dceb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:34.854363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:34.945889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b18ab-dfcd-445e-9254-b2952f35dceb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:34.980214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:34.980872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:34.981158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:34.981434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:34.991418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:34.996337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:34.997984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:34.999063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 648/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:35.004127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:35.023267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:35.103764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d86ff8-2188-4480-bdca-7e7134cb40c3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:35.137179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:35.138319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:35.138617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:35.138884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:35.139571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:35.139874 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:35.141271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:35.150529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 616/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:11:35.155745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:35.222853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:35.256744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526b3d8-5fca-416a-9f2c-d9b1fe6c45b8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:35.290736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:35.291358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:35.291638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:35.291909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:35.302692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:35.304125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:35.318455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:35.319660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:35.321056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:35.321056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:35.321056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:35.321056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 649/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:35.326153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:35.408484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:35.427519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da036da-03cd-48e5-b3a3-ec4a5032ff29 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:35.460942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:35.475692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:35.475692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:35.475692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:35.475692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:35.475692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:35.475692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:35.477142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 617/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:35.483134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:35.586637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4164add-7898-4f5f-9365-59540223e5b2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:35.653966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:35.653966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c255b-db88-4907-9f06-85125103df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:35.653966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c255b-db88-4907-9f06-85125103df21 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:35.653966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c255b-db88-4907-9f06-85125103df21 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c255b-db88-4907-9f06-85125103df21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c255b-db88-4907-9f06-85125103df21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c255b-db88-4907-9f06-85125103df21 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-146c255b-db88-4907-9f06-85125103df21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:35.654399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:35.655218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:35.656485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:35.657868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:35.657868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 650/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:35.658033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:35.754113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cb700-1a9c-4cae-a97a-6e7a9d62e9b7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:35.787743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:35.788343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:35.788626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:35.788926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:35.789646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:35.789950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:35.791368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:35.799970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:35.808496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 618/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:35.814451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c255b-db88-4907-9f06-85125103df21 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:35.913976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c255b-db88-4907-9f06-85125103df21 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:35.947620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:35.948349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:35.948634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:35.948945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:35.959649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:35.961210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:35.975290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:35.976611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:35.977747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:35.977747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:35.977747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:35.977747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 651/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:35.983535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:36.088031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04d03-5581-4bab-8a14-baadb5a71b61 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:36.123251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:36.123858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.124141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.124425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.125116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:36.125426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:36.126802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:36.138033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 619/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:36.143951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:36.182797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:36.250652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1130e5-c2cf-4cd7-b08a-2dc74b80d43f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:36.284018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246313-78b4-4992-814d-b3835856f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:36.284638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246313-78b4-4992-814d-b3835856f656 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.284953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246313-78b4-4992-814d-b3835856f656 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.285231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12246313-78b4-4992-814d-b3835856f656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.292089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12246313-78b4-4992-814d-b3835856f656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:36.294218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12246313-78b4-4992-814d-b3835856f656 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-12246313-78b4-4992-814d-b3835856f656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:36.306391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:36.307570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:36.308649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 652/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:36.313694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:36.373782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:36.414861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f4f0-bbb6-4fec-a3c4-c7a39b079ae6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:36.448005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:36.448618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.448970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.449256 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.449951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:36.450262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:36.451746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa2b89-bc4c-4f4a-9915-384dad65c4fb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:36.464688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 620/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:36.471570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246313-78b4-4992-814d-b3835856f656 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:36.567850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:36.577360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12246313-78b4-4992-814d-b3835856f656 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:36.611667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3ebcf-62ac-42e8-8f6b-2929545cf238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:36.612324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3ebcf-62ac-42e8-8f6b-2929545cf238 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.612609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3ebcf-62ac-42e8-8f6b-2929545cf238 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.612916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3ebcf-62ac-42e8-8f6b-2929545cf238 None admin] PATH_INFO: `/v3/projects/89c9d5d178204282a68c68b1dc416291/users/79c69df95a434fdeb5737455ba226320/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.614940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3ebcf-62ac-42e8-8f6b-2929545cf238 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d5d178204282a68c68b1dc416291, user_id=79c69df95a434fdeb5737455ba226320, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:36.616368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3ebcf-62ac-42e8-8f6b-2929545cf238 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:36.779710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 653/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Wed Aug 31 19:11:36 2022] PUT /identity/v3/projects/89c9d5d178204282a68c68b1dc416291/users/79c69df95a434fdeb5737455ba226320/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:11:38.699363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70570e-78a4-4c8e-af10-10df5c2925b8 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:38.699935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70570e-78a4-4c8e-af10-10df5c2925b8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:38.700049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70570e-78a4-4c8e-af10-10df5c2925b8 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:38.701880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 621/1274] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:38.706985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:38.707414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:38.707579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:38.725605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:38.726830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:38.797925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 654/1275] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:39.069518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70570e-78a4-4c8e-af10-10df5c2925b8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.173590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70570e-78a4-4c8e-af10-10df5c2925b8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:39.190729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:39.210477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:39.211142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.211420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.211714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.223054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:39.227779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:39.228944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:39.230173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 622/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:39.234985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.316156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:39.334224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88345f10-f8a8-4a70-981f-4e3718e204d3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:39.368080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:39.368684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.368997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.369268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.369947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:39.370294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:39.372155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:39.380953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 655/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:39.386916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.487486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419d1a-9473-499a-9f9f-7d6fa62c756d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:39.520788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:39.521447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.521733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.522021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.532619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:39.534105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:39.549813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:39.550960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:39.552044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:39.552044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:39.552044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:39.552044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 623/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:39.556967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.657738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e138-a2d0-494a-8b0f-ea6e2f091c84 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:39.693469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:39.694073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.694354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.694629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.695581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:39.695887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:39.697311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:39.710361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 656/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:39.716771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.749612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:39.821641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04bdd1-f92e-4fd9-be0d-6e72e00c7e40 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:39.855192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:39.855876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.856173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.856450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.864123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:39.865706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:39.877207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:39.878310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:39.879447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 624/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:39.886317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.890759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:39.985894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7b52-c26e-4eef-a8e2-b742b3a41be9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:40.020125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:40.020730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:40.021043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:40.021317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:40.022119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:40.022425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:40.023841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:40.041113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 657/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:40.046940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:40.148618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:40.157982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615e6b-1be6-47fe-9c26-fa8428773486 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:40.191219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:40.191834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:40.192119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:40.192396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:40.260897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:40.262953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:40.353059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:40.364173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 625/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Wed Aug 31 19:11:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:11:40.370067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:40.431089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:40.469476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4276-947f-43d9-8891-e7b652087dad None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:40.502569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:40.503208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:40.503497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:40.503776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:40.514388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:40.515791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:40.531905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:40.533180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:40.534457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:40.534457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:40.534457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:40.534457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 658/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:40.539220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:40.636926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69c56-c7a0-4497-9c24-89452983bb20 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:40.673138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:40.673783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:40.674066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:40.674532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:40.675187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:40.675491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:40.676900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:40.688412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 626/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:40.694292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:40.792904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cf196-7bf1-4475-b560-0b01878573c2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:40.805960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:40.826700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:40.827326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:40.827607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:40.827880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:40.834516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:40.836042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:40.848068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:40.850707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Aug 31 19:11:40.851912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 659/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:40.855625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:40.907302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:40.958764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ab05d-0dd0-401b-b63f-018b4b0013c8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:40.993763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:40.994400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:40.994719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:40.995089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:40.995782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:40.996093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:40.997617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d2fe1-6161-4260-8119-fa82fa66b0e8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:41.009955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 627/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:41.016313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:41.119396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766ac8-87d3-4ab6-8232-e4c5fed2ea2b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:41.154504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:41.155106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:41.155390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:41.155662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:41.156430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] RBAC: Adding query filter params (role.id=a3733baec72d443ab044f15928e9f85d, scope.project.id=89c9d5d178204282a68c68b1dc416291, user.id=79c69df95a434fdeb5737455ba226320) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:41.156861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:41.158558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6396e4-6cf1-4bab-90ad-2f327a58f5fe None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:41.164604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 660/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Wed Aug 31 19:11:41 2022] GET /identity/v3/role_assignments?user.id=79c69df95a434fdeb5737455ba226320&scope.project.id=89c9d5d178204282a68c68b1dc416291&role.id=a3733baec72d443ab044f15928e9f85d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:43.094210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc2117-c326-496f-b52b-50f4a2463cb0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.094759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc2117-c326-496f-b52b-50f4a2463cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.095319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc2117-c326-496f-b52b-50f4a2463cb0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.096679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 628/1288] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:43.102045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.102455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.102587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.120688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:43.122474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:43.152086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:43.188738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 661/1289] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:43.455225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc2117-c326-496f-b52b-50f4a2463cb0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:43.563224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc2117-c326-496f-b52b-50f4a2463cb0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:43.574945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:43.598317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:43.598947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.599230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.599505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.600083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:43.601498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:43.610725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:43.617958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:43.618996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 629/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:11:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:43.620062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:43.715739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6b88d-f475-4a16-96a0-a5303d122cd7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:43.749866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:43.756965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.756965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.756965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.756965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:43.756965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:43.756965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e040c-8345-4839-8ce5-77c86c6f186c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:43.759454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 662/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Wed Aug 31 19:11:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:43.765423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:43.867548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ab743-a515-4fdc-ae76-3bd45ee96193 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:43.900567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:43.901207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.901493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.901764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.902395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:43.903269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:43.904657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865f0e1-a367-4ee3-93eb-12331000c635 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:43.909353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 630/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Wed Aug 31 19:11:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:11:45.814368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36562c-8b0c-4748-895a-21a196d4767d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:45.814885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36562c-8b0c-4748-895a-21a196d4767d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:45.814885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36562c-8b0c-4748-895a-21a196d4767d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:45.816303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 663/1293] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:45.821857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de662-efcc-4585-9c15-fa0585afb5b5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:45.822279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de662-efcc-4585-9c15-fa0585afb5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:45.822392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de662-efcc-4585-9c15-fa0585afb5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:45.841550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-520de662-efcc-4585-9c15-fa0585afb5b5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:45.842734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-520de662-efcc-4585-9c15-fa0585afb5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:45.871679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:45.908453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 631/1294] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:46.184778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36562c-8b0c-4748-895a-21a196d4767d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:46.220773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:46.297450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36562c-8b0c-4748-895a-21a196d4767d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:46.333265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605597fd-ae2c-4a84-8f4e-426d18dffa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:46.333875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605597fd-ae2c-4a84-8f4e-426d18dffa6f None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:46.334159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605597fd-ae2c-4a84-8f4e-426d18dffa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:46.334435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605597fd-ae2c-4a84-8f4e-426d18dffa6f None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:46.335084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605597fd-ae2c-4a84-8f4e-426d18dffa6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:46.336447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605597fd-ae2c-4a84-8f4e-426d18dffa6f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:46.561545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 664/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Wed Aug 31 19:11:46 2022] POST /identity/v3/services => generated 246 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:11:48.548249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a940b2-fda8-4e61-9e5f-c59fa51b05bf None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:48.548675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a940b2-fda8-4e61-9e5f-c59fa51b05bf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:48.548767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a940b2-fda8-4e61-9e5f-c59fa51b05bf None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:48.550169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 632/1296] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:48.555949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:48.556422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:48.556523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:48.574789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:48.575996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:48.654702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 665/1297] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:11:48.928120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a940b2-fda8-4e61-9e5f-c59fa51b05bf None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:49.032720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a940b2-fda8-4e61-9e5f-c59fa51b05bf None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:49.067428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:49.068048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:49.068326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:49.068595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:49.069203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:49.070819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:49.079351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:49.080414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:49.081295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 633/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:11:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:49.086535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:49.105369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:49.188836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b87066-d637-481e-a2cb-9f56b6ece307 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:49.223272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:49.223917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:49.224204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:49.224477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:49.225139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:49.225444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:49.226809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:49.232441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 666/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Wed Aug 31 19:11:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:49.238607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:49.272581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:49.341291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ebd3-3aba-46de-bef3-1c0e0840a345 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:49.379195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:49.379803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:49.380084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:49.380357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:49.381093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] RBAC: Adding query filter params (interface=public, service_id=038521ab1c07475c8a40c2308c583170, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:49.381497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:49.383468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84073a89-9328-45c2-a754-b69cd04400af None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:49.389137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 634/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Wed Aug 31 19:11:49 2022] GET /identity/v3/endpoints?service_id=038521ab1c07475c8a40c2308c583170&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:49.395231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:49.475966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:49.493393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586a45b-6bad-4cd3-b70a-f632b0169888 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:49.525791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ced2b-e02d-4989-9d7e-eafe86ec0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:49.526392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ced2b-e02d-4989-9d7e-eafe86ec0b80 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:49.526670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ced2b-e02d-4989-9d7e-eafe86ec0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:49.526941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ced2b-e02d-4989-9d7e-eafe86ec0b80 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:49.527592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ced2b-e02d-4989-9d7e-eafe86ec0b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:49.528979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ced2b-e02d-4989-9d7e-eafe86ec0b80 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:49.535515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 667/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Wed Aug 31 19:11:49 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:11:51.508493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ab5a8-acbb-4ff0-80a3-0f82529f235f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.509092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ab5a8-acbb-4ff0-80a3-0f82529f235f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.509092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ab5a8-acbb-4ff0-80a3-0f82529f235f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.510465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 635/1302] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:51.516475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.521255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.521255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.535962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:51.537625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:51.609784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 668/1303] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:51.882093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ab5a8-acbb-4ff0-80a3-0f82529f235f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.980193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:51.986937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ab5a8-acbb-4ff0-80a3-0f82529f235f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:52.021173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:52.021794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:52.022075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:52.022349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:52.022929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:52.024310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:52.033158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:52.035037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 31 19:11:52.036857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 636/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:11:52.040462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:52.120217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:52.149397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be90a1-a78d-412f-a688-4881f896d94a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:52.182610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:52.183720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:52.184003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:52.184278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:52.184934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:52.185244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:52.186615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59074f4-f2df-4814-babe-295819f9d22a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:52.195068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 669/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Wed Aug 31 19:11:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:52.201586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:52.309692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f814-c5e9-4043-952c-a58f3a7528f5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:52.348318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c07d5c-18af-47d6-aba0-913f3315b778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:52.348968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07d5c-18af-47d6-aba0-913f3315b778 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:52.349254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07d5c-18af-47d6-aba0-913f3315b778 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:52.349524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07d5c-18af-47d6-aba0-913f3315b778 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:52.350200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c07d5c-18af-47d6-aba0-913f3315b778 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:52.351568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c07d5c-18af-47d6-aba0-913f3315b778 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:52.502410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 637/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:11:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:12:02.274735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=30 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:02.497251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:48.133344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301469d-d3b1-46c1-8783-8718f946d3ca None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:48.134595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301469d-d3b1-46c1-8783-8718f946d3ca None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:48.134595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301469d-d3b1-46c1-8783-8718f946d3ca None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:48.141611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81d94-0933-4bdd-8b59-9c1690c71f9c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:48.142163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81d94-0933-4bdd-8b59-9c1690c71f9c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:48.142163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81d94-0933-4bdd-8b59-9c1690c71f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:48.146883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 670/1307] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:22:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:22:48.244933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-53e81d94-0933-4bdd-8b59-9c1690c71f9c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:48.247536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-53e81d94-0933-4bdd-8b59-9c1690c71f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:48.562223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 638/1308] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:22:48.876799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c934-4a24-4e3d-aed3-dbe5f3445c99 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:48.877118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c934-4a24-4e3d-aed3-dbe5f3445c99 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:48.877603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c934-4a24-4e3d-aed3-dbe5f3445c99 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:48.879436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 671/1309] 10.222.0.76 () {54 vars in 965 bytes} [Wed Aug 31 19:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:48.889107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99124-a9d5-4a1f-afc7-292a1327fbf9 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:48.889736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99124-a9d5-4a1f-afc7-292a1327fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:48.890068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99124-a9d5-4a1f-afc7-292a1327fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:48.989155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-41c99124-a9d5-4a1f-afc7-292a1327fbf9 None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:48.990741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-41c99124-a9d5-4a1f-afc7-292a1327fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:49.022115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:49.113855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 639/1310] 10.222.0.76 () {58 vars in 1062 bytes} [Wed Aug 31 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:49.123614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67c934-4a24-4e3d-aed3-dbe5f3445c99 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:49.125562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0c67c934-4a24-4e3d-aed3-dbe5f3445c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:49.301555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67c934-4a24-4e3d-aed3-dbe5f3445c99 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:49.410764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:49.410764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:49.410764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:49.410764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:49.411456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:49.475431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:49.540488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:49.541969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6d477-ef90-4fa1-8465-f0d6baae4af5 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:49.566900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 672/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:51.866788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cd82-3679-428e-a0d5-16f3d882944b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:51.867322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cd82-3679-428e-a0d5-16f3d882944b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:51.867485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5cd82-3679-428e-a0d5-16f3d882944b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:51.868999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 640/1312] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:51.874644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208136b-e65b-4b44-9e34-4a60d32e6a99 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:51.875112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208136b-e65b-4b44-9e34-4a60d32e6a99 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:51.875240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208136b-e65b-4b44-9e34-4a60d32e6a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:51.966153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a208136b-e65b-4b44-9e34-4a60d32e6a99 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:51.967313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a208136b-e65b-4b44-9e34-4a60d32e6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:52.074794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 673/1313] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:52.356929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5cd82-3679-428e-a0d5-16f3d882944b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:52.358564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2da5cd82-3679-428e-a0d5-16f3d882944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:52.487125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5cd82-3679-428e-a0d5-16f3d882944b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:52.569632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:52.572308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:52.572955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:52.573237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:52.573511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:52.575105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:52.699141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:52.700516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9cc17-102b-49fa-8f6f-0afa8463b3bc service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:52.719522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 641/1314] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:55.441806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df777729-70b8-4062-b16c-c20ffaad1038 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:55.442327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df777729-70b8-4062-b16c-c20ffaad1038 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:55.442522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df777729-70b8-4062-b16c-c20ffaad1038 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:55.443822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 674/1315] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:55.449557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317d74c-89f8-4e32-b341-c2ecc200c24c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:55.449996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317d74c-89f8-4e32-b341-c2ecc200c24c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:55.450178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317d74c-89f8-4e32-b341-c2ecc200c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:55.518910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7317d74c-89f8-4e32-b341-c2ecc200c24c None None] MFA Rules not processed for user `3f8b36c77511497eb74133de174cd566`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:55.520168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7317d74c-89f8-4e32-b341-c2ecc200c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:55.580201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:55.635026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 642/1316] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:55.919408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df777729-70b8-4062-b16c-c20ffaad1038 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:55.921013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-df777729-70b8-4062-b16c-c20ffaad1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:55.934385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:56.033435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df777729-70b8-4062-b16c-c20ffaad1038 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:56.111350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:56.111961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:56.112241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:56.112514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:56.114187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:56.183173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:56.234873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:56.236339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee1b4-710d-434c-9644-4c77279bdb91 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:56.256413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 675/1317] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:59.198439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86dd3-5292-4550-bdb3-cccfbe46a2bf None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:59.198984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86dd3-5292-4550-bdb3-cccfbe46a2bf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:59.199202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86dd3-5292-4550-bdb3-cccfbe46a2bf None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:59.201663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 643/1318] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:22:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:59.207512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea3f8-585e-47e8-ac5c-cec5c5e57ef7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:59.208082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea3f8-585e-47e8-ac5c-cec5c5e57ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:59.208082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea3f8-585e-47e8-ac5c-cec5c5e57ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:59.283661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f0aea3f8-585e-47e8-ac5c-cec5c5e57ef7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:59.284913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f0aea3f8-585e-47e8-ac5c-cec5c5e57ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:59.405312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 676/1319] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:22:59.704277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cab94f-3f6f-4cca-b811-9bfd532407ce None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:59.704616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cab94f-3f6f-4cca-b811-9bfd532407ce None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:59.705022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cab94f-3f6f-4cca-b811-9bfd532407ce None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:59.706388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 644/1320] 10.222.0.76 () {54 vars in 965 bytes} [Wed Aug 31 19:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:59.712021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7ee0-3598-4b42-bfe1-a020b5dfb01c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:59.712317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7ee0-3598-4b42-bfe1-a020b5dfb01c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:59.712596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7ee0-3598-4b42-bfe1-a020b5dfb01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:59.735507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:59.791296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-16da7ee0-3598-4b42-bfe1-a020b5dfb01c None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:59.792564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-16da7ee0-3598-4b42-bfe1-a020b5dfb01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:59.867864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 677/1321] 10.222.0.76 () {58 vars in 1062 bytes} [Wed Aug 31 19:22:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:59.877104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cab94f-3f6f-4cca-b811-9bfd532407ce None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:59.878611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-86cab94f-3f6f-4cca-b811-9bfd532407ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:59.984514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cab94f-3f6f-4cca-b811-9bfd532407ce None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:00.058576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:00.059175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:00.059457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:00.059729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:00.061350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:00.068976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:00.170772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:00.172298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d2244-6966-437e-ae60-092019d96ea2 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:00.190795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 645/1322] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:04.008949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f1f2-dc5e-46c8-8664-390bd14e7d0c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:04.009487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f1f2-dc5e-46c8-8664-390bd14e7d0c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:04.009611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f1f2-dc5e-46c8-8664-390bd14e7d0c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:04.010943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 678/1323] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:04.016387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5e0b-3112-48eb-80cb-84435aff42d2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:04.016850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5e0b-3112-48eb-80cb-84435aff42d2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:04.016970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5e0b-3112-48eb-80cb-84435aff42d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:04.084694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e23b5e0b-3112-48eb-80cb-84435aff42d2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:04.086439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e23b5e0b-3112-48eb-80cb-84435aff42d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:04.144453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:04.185584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 646/1324] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:04.467893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8f1f2-dc5e-46c8-8664-390bd14e7d0c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:04.469681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-26a8f1f2-dc5e-46c8-8664-390bd14e7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:04.596543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8f1f2-dc5e-46c8-8664-390bd14e7d0c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:04.613655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:04.687567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:04.688177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:04.688465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:04.688736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:04.690392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:04.806068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:04.807396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc0796-338b-4cf7-a398-1310b4b49c20 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:04.826319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 679/1325] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:06.827235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2935-4f5b-4f82-b8de-0d2cda016da1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:06.827797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2935-4f5b-4f82-b8de-0d2cda016da1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:06.827797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2935-4f5b-4f82-b8de-0d2cda016da1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:06.829173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 647/1326] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:06.834328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6e474-ae02-4b60-9f4a-729f1e542513 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:06.834789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6e474-ae02-4b60-9f4a-729f1e542513 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:06.834903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6e474-ae02-4b60-9f4a-729f1e542513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:06.884485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:06.903033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-edd6e474-ae02-4b60-9f4a-729f1e542513 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:06.904250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-edd6e474-ae02-4b60-9f4a-729f1e542513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:06.999983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 680/1327] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:07.282115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa2935-4f5b-4f82-b8de-0d2cda016da1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:07.283878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d4fa2935-4f5b-4f82-b8de-0d2cda016da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:07.391449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa2935-4f5b-4f82-b8de-0d2cda016da1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:07.471013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:07.471626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:07.471904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:07.472175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:07.473888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:07.492385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:07.599401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:07.601325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32d190-10d5-4cdd-b167-00c9e2356397 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:07.623388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 648/1328] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:23:09.741445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79820c-27a4-49e4-b208-ed67f2777306 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:09.741936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79820c-27a4-49e4-b208-ed67f2777306 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:09.742637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79820c-27a4-49e4-b208-ed67f2777306 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:09.744022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 681/1329] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:09.749380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f968-caf6-4653-88a9-a7b6bb826ac1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:09.749854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f968-caf6-4653-88a9-a7b6bb826ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:09.749962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f968-caf6-4653-88a9-a7b6bb826ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:09.817715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8821f968-caf6-4653-88a9-a7b6bb826ac1 None None] MFA Rules not processed for user `3f8b36c77511497eb74133de174cd566`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:09.818937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8821f968-caf6-4653-88a9-a7b6bb826ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:09.891734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:09.924909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 649/1330] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:10.221513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79820c-27a4-49e4-b208-ed67f2777306 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:10.223258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1b79820c-27a4-49e4-b208-ed67f2777306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:10.344634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79820c-27a4-49e4-b208-ed67f2777306 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:10.368073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:10.446471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:10.447118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:10.447401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:10.447675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:10.449372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:10.566829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:10.568266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3fc28-da66-42c8-99d6-d0fd3549a5bd service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:10.587877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 682/1331] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:13.091963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f8bd-fdc4-4bb9-992e-7d3995b3e0b5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:13.092501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f8bd-fdc4-4bb9-992e-7d3995b3e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:13.092501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f8bd-fdc4-4bb9-992e-7d3995b3e0b5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:13.093890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 650/1332] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:13.099820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca5253-f5e7-47e8-9d86-2746b38bac05 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:13.100614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca5253-f5e7-47e8-9d86-2746b38bac05 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:13.100947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca5253-f5e7-47e8-9d86-2746b38bac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:13.171697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:13.174446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8dca5253-f5e7-47e8-9d86-2746b38bac05 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:13.175653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8dca5253-f5e7-47e8-9d86-2746b38bac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:13.282021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 683/1333] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:13.564098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031f8bd-fdc4-4bb9-992e-7d3995b3e0b5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:13.565708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b031f8bd-fdc4-4bb9-992e-7d3995b3e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:13.670946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031f8bd-fdc4-4bb9-992e-7d3995b3e0b5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:13.745841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:13.746458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:13.746740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:13.747020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:13.748672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:13.779793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:13.867766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:13.869254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157312f-e36e-4a3f-9155-0d211b5b714e service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:13.888688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 651/1334] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:15.865181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f985e-483a-44ee-b5fd-ae4582459caf None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:15.865732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f985e-483a-44ee-b5fd-ae4582459caf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:15.865732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f985e-483a-44ee-b5fd-ae4582459caf None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:15.867747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 684/1335] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:15.873689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab4244-b63f-4518-9532-eab92cb5387a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:15.874170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab4244-b63f-4518-9532-eab92cb5387a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:15.874283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab4244-b63f-4518-9532-eab92cb5387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:15.947305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-64ab4244-b63f-4518-9532-eab92cb5387a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:15.948683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-64ab4244-b63f-4518-9532-eab92cb5387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:16.024592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:16.047993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 652/1336] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:16.331898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f985e-483a-44ee-b5fd-ae4582459caf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:16.333478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2b4f985e-483a-44ee-b5fd-ae4582459caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:16.438466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f985e-483a-44ee-b5fd-ae4582459caf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:16.467198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:16.511564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:16.512167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:16.512447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:16.512717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:16.514385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:16.627080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:16.628453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91966a97-715e-415f-b15c-82d20a36865e service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:16.646941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 685/1337] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:19.789729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b30f-13ab-4136-b5aa-160f07bebc29 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:19.790537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b30f-13ab-4136-b5aa-160f07bebc29 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:19.790537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b30f-13ab-4136-b5aa-160f07bebc29 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:19.791919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 653/1338] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:19.800070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2b3a-71cc-4acf-a98d-d16864a84b83 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:19.800592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2b3a-71cc-4acf-a98d-d16864a84b83 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:19.800920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2b3a-71cc-4acf-a98d-d16864a84b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:19.876704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-50cf2b3a-71cc-4acf-a98d-d16864a84b83 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:19.877968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-50cf2b3a-71cc-4acf-a98d-d16864a84b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:19.886310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:19.979463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 686/1339] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:20.270954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b30f-13ab-4136-b5aa-160f07bebc29 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:20.272546 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-42e7b30f-13ab-4136-b5aa-160f07bebc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:20.396299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b30f-13ab-4136-b5aa-160f07bebc29 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:20.473152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:20.473750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:20.474027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:20.474296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:20.476584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:20.511200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:20.585671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:20.587142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c52ad-d130-4cd9-963b-3dd651b26b5a service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:20.606440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 654/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:25.340566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7ac62-3341-4c35-9a49-9a13748f6db4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:25.341469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7ac62-3341-4c35-9a49-9a13748f6db4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:25.341469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7ac62-3341-4c35-9a49-9a13748f6db4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:25.342905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 687/1341] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:25.359977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3abd-4355-43c9-98f6-08de9cf63166 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:25.360880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3abd-4355-43c9-98f6-08de9cf63166 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:25.361312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3abd-4355-43c9-98f6-08de9cf63166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:25.472791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-43ab3abd-4355-43c9-98f6-08de9cf63166 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:25.474980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-43ab3abd-4355-43c9-98f6-08de9cf63166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:25.632737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:25.649727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 655/1342] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:23:25.971519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7ac62-3341-4c35-9a49-9a13748f6db4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:25.974777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5fe7ac62-3341-4c35-9a49-9a13748f6db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:26.191682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7ac62-3341-4c35-9a49-9a13748f6db4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:26.257371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:26.327080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:26.327710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:26.327991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:26.328271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:26.330256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:26.532699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:26.535606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6cc7e-1848-4cd7-992c-db045383e6d0 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:26.565229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 688/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:30.042509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58843-9828-4c7e-8b84-0281486bae8d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:30.043052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58843-9828-4c7e-8b84-0281486bae8d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:30.043052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58843-9828-4c7e-8b84-0281486bae8d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:30.044360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 656/1344] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:23:30.050853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267515e9-5e9f-4c74-90e8-0970a04144f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:30.051676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267515e9-5e9f-4c74-90e8-0970a04144f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:30.051676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267515e9-5e9f-4c74-90e8-0970a04144f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:30.138462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-267515e9-5e9f-4c74-90e8-0970a04144f2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:30.140207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-267515e9-5e9f-4c74-90e8-0970a04144f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:30.162424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:30.287033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 689/1345] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:30.583265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58843-9828-4c7e-8b84-0281486bae8d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:30.584845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a3e58843-9828-4c7e-8b84-0281486bae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:30.738597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58843-9828-4c7e-8b84-0281486bae8d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:30.851651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:30.852180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:30.852457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:30.852725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:30.855274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:30.929217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:31.029941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:31.031928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25d637-ef05-4a13-8eef-4b27962a9ad6 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:31.057577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 657/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:23:36.410383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3626-d896-446d-a064-12936a95c7d1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:36.411220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3626-d896-446d-a064-12936a95c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:36.411220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3626-d896-446d-a064-12936a95c7d1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:36.412325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 690/1347] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:36.419191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb86b40-b3c6-456d-911f-b5a520388933 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:36.419856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb86b40-b3c6-456d-911f-b5a520388933 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:36.419968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb86b40-b3c6-456d-911f-b5a520388933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:36.532765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-deb86b40-b3c6-456d-911f-b5a520388933 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:36.532765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-deb86b40-b3c6-456d-911f-b5a520388933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:36.667685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:36.670523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 658/1348] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:36.970286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3626-d896-446d-a064-12936a95c7d1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:36.971880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-020a3626-d896-446d-a064-12936a95c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:37.138063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3626-d896-446d-a064-12936a95c7d1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:37.207572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:37.253691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:37.254366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:37.254695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:37.254992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:37.257014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:37.452286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:37.454255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b135a-0d47-45b1-a79b-61f2671510fe service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:37.480007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 691/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:42.734292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c00c3c-b08e-4c50-9c1e-b690cc945106 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:42.735199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c00c3c-b08e-4c50-9c1e-b690cc945106 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:42.735479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c00c3c-b08e-4c50-9c1e-b690cc945106 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:42.737937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 659/1350] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:42.743056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307383-d623-49ec-9e39-cc3c52b7127b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:42.743056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307383-d623-49ec-9e39-cc3c52b7127b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:42.743056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307383-d623-49ec-9e39-cc3c52b7127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:42.837582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-79307383-d623-49ec-9e39-cc3c52b7127b None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:42.838965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-79307383-d623-49ec-9e39-cc3c52b7127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:42.863356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:43.046887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 692/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:23:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:47.630780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597dd9-af17-49c2-8fa8-76265ed2eeac None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:47.631803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597dd9-af17-49c2-8fa8-76265ed2eeac None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:47.631803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597dd9-af17-49c2-8fa8-76265ed2eeac None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:47.633557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 660/1352] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:47.639140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14e6d2-32db-464d-8113-6c5cc2e74f3e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:47.640097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14e6d2-32db-464d-8113-6c5cc2e74f3e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:47.640604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14e6d2-32db-464d-8113-6c5cc2e74f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:47.732685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2b14e6d2-32db-464d-8113-6c5cc2e74f3e None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:47.734423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2b14e6d2-32db-464d-8113-6c5cc2e74f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:47.821011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:47.861965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 693/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:23:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:49.348105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33b8d-7cc9-4235-83f8-14eec4e084f5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:49.349270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33b8d-7cc9-4235-83f8-14eec4e084f5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:49.349270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33b8d-7cc9-4235-83f8-14eec4e084f5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:49.351103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 661/1354] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:49.357594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66cab-009e-4302-b52c-227799d059b6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:49.358360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66cab-009e-4302-b52c-227799d059b6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:49.358538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66cab-009e-4302-b52c-227799d059b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:49.451953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1ed66cab-009e-4302-b52c-227799d059b6 None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:49.453377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1ed66cab-009e-4302-b52c-227799d059b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:49.583927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 694/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:23:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:23:53.032852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae1a5-0dc8-41fb-a0c6-846c8af3db1c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:53.033347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae1a5-0dc8-41fb-a0c6-846c8af3db1c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:53.033347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae1a5-0dc8-41fb-a0c6-846c8af3db1c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:53.034677 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 662/1356] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:53.040174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344b25-784f-4e8c-890a-c8210d6446c1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:53.040559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344b25-784f-4e8c-890a-c8210d6446c1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:53.040735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344b25-784f-4e8c-890a-c8210d6446c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:53.078505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:53.111460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-91344b25-784f-4e8c-890a-c8210d6446c1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:53.112841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-91344b25-784f-4e8c-890a-c8210d6446c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:53.244233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 695/1357] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:53.570827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c611f-70b4-495a-909c-78e4c99a17cd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:53.571042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c611f-70b4-495a-909c-78e4c99a17cd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:53.571775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c611f-70b4-495a-909c-78e4c99a17cd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:53.573156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 663/1358] 10.222.0.76 () {54 vars in 962 bytes} [Wed Aug 31 19:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:53.582681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc642-49a9-42a1-9c42-3d398c871f78 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:53.583131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc642-49a9-42a1-9c42-3d398c871f78 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:53.583549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cc642-49a9-42a1-9c42-3d398c871f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:53.683774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f63cc642-49a9-42a1-9c42-3d398c871f78 None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:53.685179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f63cc642-49a9-42a1-9c42-3d398c871f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:53.743908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:53.842798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 696/1359] 10.222.0.76 () {58 vars in 1059 bytes} [Wed Aug 31 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:23:53.852937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c611f-70b4-495a-909c-78e4c99a17cd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:53.854523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-258c611f-70b4-495a-909c-78e4c99a17cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:54.022211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c611f-70b4-495a-909c-78e4c99a17cd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:54.108721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:54.158587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:54.159203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:54.159479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:54.159746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:54.161384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:54.283858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:54.285771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484cb4f-2bfa-4a81-b451-a4a546b234c4 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:54.324970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 664/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:56.598800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bf124-c3e9-4bb0-bb7d-a8e2a8f6654e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:56.599915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bf124-c3e9-4bb0-bb7d-a8e2a8f6654e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:56.600000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bf124-c3e9-4bb0-bb7d-a8e2a8f6654e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:56.601547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 697/1361] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:56.606846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a5ca-9721-4580-8081-18fc32d386fc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:56.607293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a5ca-9721-4580-8081-18fc32d386fc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:56.607692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a5ca-9721-4580-8081-18fc32d386fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:56.691474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6e37a5ca-9721-4580-8081-18fc32d386fc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:56.693827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6e37a5ca-9721-4580-8081-18fc32d386fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:56.738079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:56.828861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 665/1362] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:57.380080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bf124-c3e9-4bb0-bb7d-a8e2a8f6654e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:57.382020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-066bf124-c3e9-4bb0-bb7d-a8e2a8f6654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:57.616752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bf124-c3e9-4bb0-bb7d-a8e2a8f6654e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:57.628936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:57.754865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:57.755546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:57.755828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:57.756102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:57.758165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:57.897805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:57.899418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06f16b-8b35-490a-9edf-36a4f510bac7 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:57.925049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 698/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:00.420215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eba7d-9f02-40b9-a385-73a1b98b3a46 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:00.420784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eba7d-9f02-40b9-a385-73a1b98b3a46 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:00.420784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eba7d-9f02-40b9-a385-73a1b98b3a46 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:00.422168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 666/1364] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:00.427842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913cc7-49ff-4215-8736-b93f2a871556 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:00.428294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913cc7-49ff-4215-8736-b93f2a871556 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:00.428538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913cc7-49ff-4215-8736-b93f2a871556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:00.453782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:00.519375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2b913cc7-49ff-4215-8736-b93f2a871556 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:00.521880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2b913cc7-49ff-4215-8736-b93f2a871556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:00.660084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 699/1365] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:00.972207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15abca-af8d-4183-a9fa-0ec3a612fa0f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:00.972594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15abca-af8d-4183-a9fa-0ec3a612fa0f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:00.973153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15abca-af8d-4183-a9fa-0ec3a612fa0f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:00.990977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 667/1366] 10.222.0.76 () {54 vars in 962 bytes} [Wed Aug 31 19:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:00.991141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e29de-1205-4ea1-96f6-0eb8f0b24a78 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:00.991141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e29de-1205-4ea1-96f6-0eb8f0b24a78 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:00.991141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e29de-1205-4ea1-96f6-0eb8f0b24a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:01.102936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c18e29de-1205-4ea1-96f6-0eb8f0b24a78 None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:01.106211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c18e29de-1205-4ea1-96f6-0eb8f0b24a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:01.159433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:01.294772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 700/1367] 10.222.0.76 () {58 vars in 1059 bytes} [Wed Aug 31 19:24:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:01.310061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15abca-af8d-4183-a9fa-0ec3a612fa0f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:01.312096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8b15abca-af8d-4183-a9fa-0ec3a612fa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:01.509630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15abca-af8d-4183-a9fa-0ec3a612fa0f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:01.553798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:01.663951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:01.664575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:01.664888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:01.665167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:01.666924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:01.774703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:01.776432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166257a-59f0-4fb1-9021-e7a736456334 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:01.815840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 668/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:01.906242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42a988-35c6-4f68-9176-c1b273ef21e3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:01.907171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42a988-35c6-4f68-9176-c1b273ef21e3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:01.907171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42a988-35c6-4f68-9176-c1b273ef21e3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:01.908383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 701/1369] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:24:01.915073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a5b43-34e6-4952-87fc-6fb9055647db None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:01.915406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a5b43-34e6-4952-87fc-6fb9055647db None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:01.916053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a5b43-34e6-4952-87fc-6fb9055647db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:01.963032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:02.013358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8c6a5b43-34e6-4952-87fc-6fb9055647db None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:02.015110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8c6a5b43-34e6-4952-87fc-6fb9055647db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:02.194023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 669/1370] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:02.879699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd069-a91f-4176-abd3-c7aea93896b5 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:02.879879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd069-a91f-4176-abd3-c7aea93896b5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:02.880115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd069-a91f-4176-abd3-c7aea93896b5 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:02.882503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 702/1371] 10.222.0.76 () {54 vars in 964 bytes} [Wed Aug 31 19:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:02.890340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80cb17-1b4f-42b1-b988-d2db8fa2716d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:02.891078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80cb17-1b4f-42b1-b988-d2db8fa2716d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:02.891078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80cb17-1b4f-42b1-b988-d2db8fa2716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:02.994981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3a80cb17-1b4f-42b1-b988-d2db8fa2716d None None] MFA Rules not processed for user `50774a4923ce4027a7c36d9972e53e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:02.996269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3a80cb17-1b4f-42b1-b988-d2db8fa2716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:03.053107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:03.096933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 670/1372] 10.222.0.76 () {58 vars in 1061 bytes} [Wed Aug 31 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:03.109033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd069-a91f-4176-abd3-c7aea93896b5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:03.111245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7e5bd069-a91f-4176-abd3-c7aea93896b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:03.236232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd069-a91f-4176-abd3-c7aea93896b5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:03.284173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:03.329657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:03.330667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:03.331375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:03.331709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:03.334955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:03.496439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:03.497970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b441fd4-9cc5-48fb-abc4-3ac92cf3a11b service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:03.520058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 703/1373] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:04.394413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e020-34f7-4159-80d0-656f13efa540 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:04.394984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e020-34f7-4159-80d0-656f13efa540 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:04.395112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22e020-34f7-4159-80d0-656f13efa540 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:04.396446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 671/1374] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:04.406554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00bc8d-43eb-43c8-9fd3-e8043ae9a5ae None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:04.407083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00bc8d-43eb-43c8-9fd3-e8043ae9a5ae None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:04.407194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00bc8d-43eb-43c8-9fd3-e8043ae9a5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:04.492692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5d00bc8d-43eb-43c8-9fd3-e8043ae9a5ae None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:04.493864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5d00bc8d-43eb-43c8-9fd3-e8043ae9a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:04.518492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:04.607497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 704/1375] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:04.903893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e020-34f7-4159-80d0-656f13efa540 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:04.905878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-df22e020-34f7-4159-80d0-656f13efa540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:05.085783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22e020-34f7-4159-80d0-656f13efa540 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:05.154746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:05.225818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:05.226426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.226708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.226981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:05.228569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:05.322018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:05.323613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0dbe-32ab-46cc-9f55-19ef77ce5c55 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:05.357185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 672/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:24:07.667746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284c53f-7ac9-4cbd-ad02-94577498bbfe None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:07.668442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284c53f-7ac9-4cbd-ad02-94577498bbfe None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:07.668442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284c53f-7ac9-4cbd-ad02-94577498bbfe None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:07.669716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 705/1377] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:07.675305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c627c-25c7-48e1-aa22-875697c576a1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:07.675799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c627c-25c7-48e1-aa22-875697c576a1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:07.675912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c627c-25c7-48e1-aa22-875697c576a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:07.763036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9d3c627c-25c7-48e1-aa22-875697c576a1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:07.768692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9d3c627c-25c7-48e1-aa22-875697c576a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:07.776678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:07.916002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 673/1378] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:08.253302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284c53f-7ac9-4cbd-ad02-94577498bbfe None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:08.255580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0284c53f-7ac9-4cbd-ad02-94577498bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:08.450749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284c53f-7ac9-4cbd-ad02-94577498bbfe None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:08.457363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:08.670048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:08.670847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:08.671424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:08.671840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:08.673781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:08.797708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:08.800136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e12345-a8c4-4c86-938f-47cbffd4d3b3 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:08.822947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 706/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:11.329755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9148c1-12aa-4959-8ec4-c8cef735ed96 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:11.330569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9148c1-12aa-4959-8ec4-c8cef735ed96 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:11.330569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9148c1-12aa-4959-8ec4-c8cef735ed96 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:11.331744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 674/1380] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:24:11.340167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1da7-d5fc-439b-be6d-2c8ac0112f9e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:11.340903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1da7-d5fc-439b-be6d-2c8ac0112f9e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:11.341090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1da7-d5fc-439b-be6d-2c8ac0112f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:11.354534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:11.423450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e89c1da7-d5fc-439b-be6d-2c8ac0112f9e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:11.425017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e89c1da7-d5fc-439b-be6d-2c8ac0112f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:11.551343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 707/1381] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:11.846001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9148c1-12aa-4959-8ec4-c8cef735ed96 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:11.847514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fd9148c1-12aa-4959-8ec4-c8cef735ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:12.014905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:12.026207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9148c1-12aa-4959-8ec4-c8cef735ed96 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:12.191384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:12.191918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:12.192960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:12.192960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:12.194766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:12.328612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:12.330370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9356e-0e1b-4bad-a98d-3b81f50bcfcf service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:12.343331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:12.352731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 675/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:14.691258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523553-a25b-444e-9e56-4ea4ce1d4246 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:14.692059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523553-a25b-444e-9e56-4ea4ce1d4246 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:14.692639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523553-a25b-444e-9e56-4ea4ce1d4246 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:14.696239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 708/1383] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:14.705111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2ba5-a163-4fae-8872-791cbf6173d6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:14.706892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2ba5-a163-4fae-8872-791cbf6173d6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:14.706892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2ba5-a163-4fae-8872-791cbf6173d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:14.806455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-77fe2ba5-a163-4fae-8872-791cbf6173d6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:14.807820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-77fe2ba5-a163-4fae-8872-791cbf6173d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:14.934501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 676/1384] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:15.230264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523553-a25b-444e-9e56-4ea4ce1d4246 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:15.232408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b1523553-a25b-444e-9e56-4ea4ce1d4246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:15.355489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:15.452670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523553-a25b-444e-9e56-4ea4ce1d4246 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:15.646829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:15.646829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:15.646829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:15.646829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:15.649865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:15.714143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:15.769668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:15.771244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cdb7f-195e-4318-a515-615dfc9f3b5b service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:15.795009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 709/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:24:18.287977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dbbb-6aaf-4a92-b83e-592a5174d51c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:18.288549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dbbb-6aaf-4a92-b83e-592a5174d51c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:18.288549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dbbb-6aaf-4a92-b83e-592a5174d51c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:18.289905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 677/1386] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:18.295238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2cfc-a71d-4a1f-a996-62a3da24ed7f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:18.295684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2cfc-a71d-4a1f-a996-62a3da24ed7f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:18.295839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2cfc-a71d-4a1f-a996-62a3da24ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:18.366135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0ffd2cfc-a71d-4a1f-a996-62a3da24ed7f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:18.367364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0ffd2cfc-a71d-4a1f-a996-62a3da24ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:18.483753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 710/1387] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:18.780586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dbbb-6aaf-4a92-b83e-592a5174d51c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:18.782435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8784dbbb-6aaf-4a92-b83e-592a5174d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:18.866675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:18.941134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dbbb-6aaf-4a92-b83e-592a5174d51c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:19.086715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:19.087478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:19.087834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:19.088116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:19.089869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:19.140051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:19.202119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:19.203735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e170f55-1524-494c-8ee7-14ff15eef6a8 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:19.229041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 678/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:24:20.018263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f0c3-229f-486b-a03f-4d8afc61f60e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:20.018841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f0c3-229f-486b-a03f-4d8afc61f60e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:20.018968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f0c3-229f-486b-a03f-4d8afc61f60e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:20.020965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 711/1389] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:20.027231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ed20-8aed-4124-b481-cbf1f8cb17d0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:20.027891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ed20-8aed-4124-b481-cbf1f8cb17d0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:20.027891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ed20-8aed-4124-b481-cbf1f8cb17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:20.108172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cde4ed20-8aed-4124-b481-cbf1f8cb17d0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:20.109416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cde4ed20-8aed-4124-b481-cbf1f8cb17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:20.216863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 679/1390] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:20.532565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88c34f-d342-428b-b782-730508dafdab None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:20.532888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88c34f-d342-428b-b782-730508dafdab None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:20.533326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88c34f-d342-428b-b782-730508dafdab None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:20.534745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 712/1391] 10.222.0.76 () {54 vars in 967 bytes} [Wed Aug 31 19:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:20.541414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042002ed-195e-4529-90e6-ad359bab1c4f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:20.541793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042002ed-195e-4529-90e6-ad359bab1c4f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:20.542303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042002ed-195e-4529-90e6-ad359bab1c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:20.560210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:20.631245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-042002ed-195e-4529-90e6-ad359bab1c4f None None] MFA Rules not processed for user `011b9ddf05d14d75aaa67fb395ec7312`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:20.632423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-042002ed-195e-4529-90e6-ad359bab1c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:20.715498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 680/1392] 10.222.0.76 () {58 vars in 1064 bytes} [Wed Aug 31 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:20.724705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88c34f-d342-428b-b782-730508dafdab None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:20.726561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3f88c34f-d342-428b-b782-730508dafdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:20.759692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:20.844206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88c34f-d342-428b-b782-730508dafdab None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:20.922294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:20.922841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:20.923072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:20.923437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:20.924976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:21.012158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:21.048465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:21.050301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1e3b-c741-451b-9a5d-aec63cd28737 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:21.074295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 713/1393] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:21.396742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc918b-5dc0-462d-9cc0-48bbb1b1f5cd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:21.397311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc918b-5dc0-462d-9cc0-48bbb1b1f5cd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:21.402201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc918b-5dc0-462d-9cc0-48bbb1b1f5cd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:21.402201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 681/1394] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:21.406782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d76975-7df0-4353-9eca-8d5f559c99db None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:21.407080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d76975-7df0-4353-9eca-8d5f559c99db None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:21.407370 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d76975-7df0-4353-9eca-8d5f559c99db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:21.481003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-02d76975-7df0-4353-9eca-8d5f559c99db None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:21.482339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-02d76975-7df0-4353-9eca-8d5f559c99db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:21.619747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 714/1395] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:21.913727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc918b-5dc0-462d-9cc0-48bbb1b1f5cd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:21.918041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b7cc918b-5dc0-462d-9cc0-48bbb1b1f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.029053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:22.075220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc918b-5dc0-462d-9cc0-48bbb1b1f5cd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:22.139853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc64ac7-b0a6-4008-b552-2cb831c98ca2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:22.140460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc64ac7-b0a6-4008-b552-2cb831c98ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:22.140460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc64ac7-b0a6-4008-b552-2cb831c98ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:22.188796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:22.207089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:22.207711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:22.207989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:22.208320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:22.210076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.212947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6dc64ac7-b0a6-4008-b552-2cb831c98ca2 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:22.214289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6dc64ac7-b0a6-4008-b552-2cb831c98ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.287937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:22.311254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:22.317752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c8c58-062e-4823-b245-6de484d5b758 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:22.320171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 715/1396] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:24:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:24:22.341231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 682/1397] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:22.367191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78060f44-9b41-463b-b56b-c7b1ba8b7dae None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:22.370630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78060f44-9b41-463b-b56b-c7b1ba8b7dae None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:22.370630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78060f44-9b41-463b-b56b-c7b1ba8b7dae None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:22.370630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 716/1398] 10.222.0.76 () {54 vars in 943 bytes} [Wed Aug 31 19:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:22.378554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b8dc-888f-4884-9751-d596b5e53eca None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:22.379010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b8dc-888f-4884-9751-d596b5e53eca None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:22.379410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b8dc-888f-4884-9751-d596b5e53eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:22.473965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-88a6b8dc-888f-4884-9751-d596b5e53eca None None] MFA Rules not processed for user `a7266140e48e4588a147704a0b83bb21`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:22.475200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-88a6b8dc-888f-4884-9751-d596b5e53eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.609160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 683/1399] 10.222.0.76 () {58 vars in 1040 bytes} [Wed Aug 31 19:24:22 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:24:22.619939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78060f44-9b41-463b-b56b-c7b1ba8b7dae None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:22.621685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-78060f44-9b41-463b-b56b-c7b1ba8b7dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.778778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:22.786508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78060f44-9b41-463b-b56b-c7b1ba8b7dae None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:22.902333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:22.903858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:22.904546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:22.904970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:22.907403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.998596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:23.000195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6def8-28ee-464c-b7fb-bc5086015f87 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:23.008758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 717/1400] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:24:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:24:24.516336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44369e7a-7cdd-4bec-9e2f-6d5ee2f49ef4 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:24.517100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44369e7a-7cdd-4bec-9e2f-6d5ee2f49ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:24.517100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44369e7a-7cdd-4bec-9e2f-6d5ee2f49ef4 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:24.518698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 684/1401] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:24.524900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb6f3f-424a-4324-91de-3a7b388abec1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:24.525420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb6f3f-424a-4324-91de-3a7b388abec1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:24.525661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb6f3f-424a-4324-91de-3a7b388abec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:24.568023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:24.611076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-99fb6f3f-424a-4324-91de-3a7b388abec1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:24.612476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-99fb6f3f-424a-4324-91de-3a7b388abec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:24.753448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 718/1402] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:25.049526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44369e7a-7cdd-4bec-9e2f-6d5ee2f49ef4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:25.051601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-44369e7a-7cdd-4bec-9e2f-6d5ee2f49ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:25.082948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:25.231345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44369e7a-7cdd-4bec-9e2f-6d5ee2f49ef4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:25.361636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:25.386506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:25.387127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:25.387426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:25.387773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:25.389446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:25.504300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:25.507626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513936-b6c7-4d61-8620-4168503014f0 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:25.531976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 685/1403] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:27.854096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed533-4746-4ab3-b013-b7c3f3b9ec15 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:27.854096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed533-4746-4ab3-b013-b7c3f3b9ec15 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:27.854096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed533-4746-4ab3-b013-b7c3f3b9ec15 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:27.854096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 719/1404] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:24:27.854794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd966f5-24d9-4fa6-97d0-c713af25efe1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:27.854794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd966f5-24d9-4fa6-97d0-c713af25efe1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:27.854794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd966f5-24d9-4fa6-97d0-c713af25efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:27.891471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9bd966f5-24d9-4fa6-97d0-c713af25efe1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:27.893226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9bd966f5-24d9-4fa6-97d0-c713af25efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:27.974907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:28.028859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 686/1405] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:28.352768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ed533-4746-4ab3-b013-b7c3f3b9ec15 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:28.354594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-366ed533-4746-4ab3-b013-b7c3f3b9ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:28.471301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:28.532178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ed533-4746-4ab3-b013-b7c3f3b9ec15 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:28.674128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:28.674785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:28.675129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:28.675472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:28.678876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:28.760015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:28.790250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:28.792327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c8509-9537-4548-b087-94e7cb88dc98 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:28.813213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 720/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:31.024401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275e7db-445f-4f85-a499-b8b65388b735 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:31.025027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275e7db-445f-4f85-a499-b8b65388b735 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:31.025027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275e7db-445f-4f85-a499-b8b65388b735 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:31.026484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 687/1407] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:31.031526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67fa6-254d-4ccc-b213-d62d7acf64be None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:31.031971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67fa6-254d-4ccc-b213-d62d7acf64be None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:31.032077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67fa6-254d-4ccc-b213-d62d7acf64be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:31.104527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-32e67fa6-254d-4ccc-b213-d62d7acf64be None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:31.106169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-32e67fa6-254d-4ccc-b213-d62d7acf64be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:31.217658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 721/1408] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:31.531617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275e7db-445f-4f85-a499-b8b65388b735 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:31.534796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8275e7db-445f-4f85-a499-b8b65388b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:31.721993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275e7db-445f-4f85-a499-b8b65388b735 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:31.783433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:31.873558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:31.874220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:31.874500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:31.874796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:31.876604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:31.981712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:31.983484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a865-d626-4eec-b1fe-197728f146ea service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:32.005162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 688/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:41.215208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=81 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:42.002314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=78 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:47.524532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57b61-1c95-476d-b6f7-d2dfce4cc17f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:47.525093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57b61-1c95-476d-b6f7-d2dfce4cc17f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:47.525093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57b61-1c95-476d-b6f7-d2dfce4cc17f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:47.526474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 722/1410] 10.222.0.76 () {54 vars in 918 bytes} [Wed Aug 31 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:47.532278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680fca-3513-497b-b4bb-a5663e43ee23 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:47.533181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680fca-3513-497b-b4bb-a5663e43ee23 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:47.533181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680fca-3513-497b-b4bb-a5663e43ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:47.611103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-df680fca-3513-497b-b4bb-a5663e43ee23 None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:47.613012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-df680fca-3513-497b-b4bb-a5663e43ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:47.723298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 689/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Wed Aug 31 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:47.738274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb250-a4e6-49a4-807c-b3d6403b1de2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:47.738571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb250-a4e6-49a4-807c-b3d6403b1de2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:47.738862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb250-a4e6-49a4-807c-b3d6403b1de2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:47.740205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 723/1412] 10.222.0.76 () {54 vars in 918 bytes} [Wed Aug 31 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:47.744972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672617d2-d452-4b5e-8f21-83d4ec6003fd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:47.745259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672617d2-d452-4b5e-8f21-83d4ec6003fd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:47.745536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672617d2-d452-4b5e-8f21-83d4ec6003fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:47.825352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:47.828566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-672617d2-d452-4b5e-8f21-83d4ec6003fd None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:47.829891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-672617d2-d452-4b5e-8f21-83d4ec6003fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:47.954522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 690/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Wed Aug 31 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:50.429951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b46c-0e9f-4f5f-b738-e443ef76f1e2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:50.430514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b46c-0e9f-4f5f-b738-e443ef76f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:50.430630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b46c-0e9f-4f5f-b738-e443ef76f1e2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:50.432149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 724/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:50.437568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c1f6b-e6a4-4d3e-94f0-f00754dc6c8e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:50.445922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c1f6b-e6a4-4d3e-94f0-f00754dc6c8e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:50.445922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c1f6b-e6a4-4d3e-94f0-f00754dc6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:50.505816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e25c1f6b-e6a4-4d3e-94f0-f00754dc6c8e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:50.507016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e25c1f6b-e6a4-4d3e-94f0-f00754dc6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:50.563240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:50.606021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 691/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:24:50.898772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b46c-0e9f-4f5f-b738-e443ef76f1e2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:50.900286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-edd7b46c-0e9f-4f5f-b738-e443ef76f1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:51.063435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b46c-0e9f-4f5f-b738-e443ef76f1e2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:51.138121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:51.180231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:51.180875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:51.181162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:51.181439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:51.183218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:51.277609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:51.279239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99114657-7fee-4a6c-bca1-7fedaf77c6bd service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:51.298411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 725/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:52.202883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdafae-549e-4d01-91e3-13609d415283 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:52.203474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdafae-549e-4d01-91e3-13609d415283 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:52.203474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdafae-549e-4d01-91e3-13609d415283 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:52.204938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 692/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:52.210582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0daa-d68c-44bb-88fc-e6d7eb736ff2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:52.211024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0daa-d68c-44bb-88fc-e6d7eb736ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:52.211132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0daa-d68c-44bb-88fc-e6d7eb736ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:52.289144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7b9b0daa-d68c-44bb-88fc-e6d7eb736ff2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:52.290372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7b9b0daa-d68c-44bb-88fc-e6d7eb736ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:52.317873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:52.388352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 726/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:52.541105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdafae-549e-4d01-91e3-13609d415283 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:52.542538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9bcdafae-549e-4d01-91e3-13609d415283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:52.695552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdafae-549e-4d01-91e3-13609d415283 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:52.739705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:52.814101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:52.814458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:52.814740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:52.815034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:52.817421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:52.914348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:52.915979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef838b-7a9e-403d-8652-4ee314cad80c service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:52.938814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 693/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:53.842619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64152d8-1e26-4a1f-b4f7-bdd1a13f4597 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:53.843135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64152d8-1e26-4a1f-b4f7-bdd1a13f4597 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:53.843232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64152d8-1e26-4a1f-b4f7-bdd1a13f4597 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:53.844567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 727/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:53.849669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5a536-d5a1-4c2d-8a10-76fc0b1c361f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:53.850116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5a536-d5a1-4c2d-8a10-76fc0b1c361f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:53.850212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5a536-d5a1-4c2d-8a10-76fc0b1c361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:53.911096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:53.936789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d4e5a536-d5a1-4c2d-8a10-76fc0b1c361f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:53.938040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d4e5a536-d5a1-4c2d-8a10-76fc0b1c361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:54.039200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 694/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:54.194016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64152d8-1e26-4a1f-b4f7-bdd1a13f4597 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:54.195625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d64152d8-1e26-4a1f-b4f7-bdd1a13f4597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:54.355438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64152d8-1e26-4a1f-b4f7-bdd1a13f4597 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:54.367983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:54.470450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:54.470967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:54.471325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:54.471653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:54.473304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:54.563308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:54.564966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33879c54-368a-48e7-a756-92ebe3cabcf4 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:54.583865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 728/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:55.453519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a589-23cd-40fd-979c-f236e060bb7b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:55.454060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a589-23cd-40fd-979c-f236e060bb7b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:55.454060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a589-23cd-40fd-979c-f236e060bb7b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:55.455538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 695/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:55.461290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecd826-b2e5-4914-ae96-7029a2546f98 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:55.461744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecd826-b2e5-4914-ae96-7029a2546f98 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:55.461850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecd826-b2e5-4914-ae96-7029a2546f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:55.481660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:55.541092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cbecd826-b2e5-4914-ae96-7029a2546f98 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:55.542368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cbecd826-b2e5-4914-ae96-7029a2546f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:55.648663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 729/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:55.800217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a589-23cd-40fd-979c-f236e060bb7b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:55.801922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9054a589-23cd-40fd-979c-f236e060bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:55.913191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:55.952168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a589-23cd-40fd-979c-f236e060bb7b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:56.068271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:56.068916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:56.069208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:56.069490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:56.071150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:56.150189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:56.165070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:56.166632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa5832-5043-4ca0-980a-124ab1ba6c57 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:56.187002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 696/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:57.056716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bd69b-8e65-458e-a61c-ceeadc367a22 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:57.057297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bd69b-8e65-458e-a61c-ceeadc367a22 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:57.057297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bd69b-8e65-458e-a61c-ceeadc367a22 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:57.058692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 730/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:57.063805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf246-7415-4483-84b0-7e5b2f003af7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:57.064229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf246-7415-4483-84b0-7e5b2f003af7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:57.064339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf246-7415-4483-84b0-7e5b2f003af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:57.142534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b34cf246-7415-4483-84b0-7e5b2f003af7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:57.144346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b34cf246-7415-4483-84b0-7e5b2f003af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:57.243647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 697/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:57.395653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bd69b-8e65-458e-a61c-ceeadc367a22 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:57.397227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1d0bd69b-8e65-458e-a61c-ceeadc367a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:57.483409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:57.547196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bd69b-8e65-458e-a61c-ceeadc367a22 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:57.662289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:57.662810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:57.663092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:57.663366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:57.665012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:57.714185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:57.755904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:57.757602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9edd5-5552-4692-810d-7d2bdffa396c service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:57.775648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 731/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:58.756639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3095-5578-4263-9015-f10af01d8281 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:58.757200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3095-5578-4263-9015-f10af01d8281 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:58.757298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3095-5578-4263-9015-f10af01d8281 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:58.758585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 698/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:24:58.763780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55691fc5-19b4-4eca-978e-913bfb942490 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:58.764231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55691fc5-19b4-4eca-978e-913bfb942490 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:58.764373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55691fc5-19b4-4eca-978e-913bfb942490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:58.842844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-55691fc5-19b4-4eca-978e-913bfb942490 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:58.844140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-55691fc5-19b4-4eca-978e-913bfb942490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:58.948892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 732/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:59.101517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3095-5578-4263-9015-f10af01d8281 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:59.102191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ad6f3095-5578-4263-9015-f10af01d8281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:59.153931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:59.253051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3095-5578-4263-9015-f10af01d8281 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:59.366303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:59.366818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:59.367093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:59.367362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:59.369057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:59.376305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:59.459006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:59.460627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753c7f0-f7ac-437c-b4fa-bb2a3ff6258e service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:59.478370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 699/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:00.482684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863556-446f-48df-950f-dda566515d9d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:00.483273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863556-446f-48df-950f-dda566515d9d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:00.483273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863556-446f-48df-950f-dda566515d9d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:00.484488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 733/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:25:00.490812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173179d-7f6c-4235-a5bf-70494c130a0a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:00.491296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173179d-7f6c-4235-a5bf-70494c130a0a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:00.491413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173179d-7f6c-4235-a5bf-70494c130a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:00.569938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2173179d-7f6c-4235-a5bf-70494c130a0a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:00.571171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2173179d-7f6c-4235-a5bf-70494c130a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:00.639719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:00.669184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 700/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:00.824437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0863556-446f-48df-950f-dda566515d9d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:00.826036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a0863556-446f-48df-950f-dda566515d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:00.843663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:00.975280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0863556-446f-48df-950f-dda566515d9d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:01.062038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:01.087679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:01.088194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:01.088480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:01.088756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:01.090518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:01.185367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:01.186999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adada24b-29b0-48bb-aa5c-89d94802105d service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:01.205234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 734/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:02.155324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525058b-1d7d-43ae-bee1-6bcb7c5143fe None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:02.155933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525058b-1d7d-43ae-bee1-6bcb7c5143fe None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:02.155933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525058b-1d7d-43ae-bee1-6bcb7c5143fe None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:02.157268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 701/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:02.163371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a86c-49ed-4fc6-a166-a465ba6a237e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:02.163845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a86c-49ed-4fc6-a166-a465ba6a237e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:02.163953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a86c-49ed-4fc6-a166-a465ba6a237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:02.242888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7314a86c-49ed-4fc6-a166-a465ba6a237e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:02.244105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7314a86c-49ed-4fc6-a166-a465ba6a237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:02.287332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:02.347238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 735/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:02.497848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525058b-1d7d-43ae-bee1-6bcb7c5143fe None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:02.499323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a525058b-1d7d-43ae-bee1-6bcb7c5143fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:02.650119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525058b-1d7d-43ae-bee1-6bcb7c5143fe None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:02.707563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:02.766818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:02.767344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:02.767619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:02.768507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:02.770129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:02.862272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:02.863889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08ff13-d601-4884-bc02-ac94f6838e11 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:02.882694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 702/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:03.790423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c9dd-99be-4657-9157-aa8da8d40e40 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:03.790961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c9dd-99be-4657-9157-aa8da8d40e40 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:03.790961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c9dd-99be-4657-9157-aa8da8d40e40 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:03.792333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 736/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:03.797586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e438-6907-4031-b41e-9f290245b0e3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:03.798013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e438-6907-4031-b41e-9f290245b0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:03.798108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e438-6907-4031-b41e-9f290245b0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:03.875672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a395e438-6907-4031-b41e-9f290245b0e3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:03.876964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a395e438-6907-4031-b41e-9f290245b0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:03.879663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:03.975083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 703/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:04.123567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c9dd-99be-4657-9157-aa8da8d40e40 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.125145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-71b2c9dd-99be-4657-9157-aa8da8d40e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.278153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c9dd-99be-4657-9157-aa8da8d40e40 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.306460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:04.392017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.392543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.393386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.393666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.395281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.484008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.485932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41f274-a6c1-4d3f-9789-c5381c246ffd service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.503767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 737/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:06.347054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6494-5667-4281-acda-d56d8903a74a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:06.347750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6494-5667-4281-acda-d56d8903a74a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:06.347909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6494-5667-4281-acda-d56d8903a74a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:06.350214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 704/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:06.356727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c81bbd-a876-4c33-a956-cbd0a5503a70 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:06.357424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c81bbd-a876-4c33-a956-cbd0a5503a70 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:06.357567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c81bbd-a876-4c33-a956-cbd0a5503a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:06.420871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:06.467627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-73c81bbd-a876-4c33-a956-cbd0a5503a70 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:06.469889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-73c81bbd-a876-4c33-a956-cbd0a5503a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:06.650957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 738/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:06.953182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6494-5667-4281-acda-d56d8903a74a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:06.954752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d58b6494-5667-4281-acda-d56d8903a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:07.068510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6494-5667-4281-acda-d56d8903a74a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:07.105529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:07.148066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:07.148669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:07.148981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:07.149255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:07.150870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:07.258950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:07.260313 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ca3ee-acee-42a5-8768-8269926d93a8 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:07.280897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 705/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:09.365015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd0cb-bc13-4655-91a0-cc54d5c21caa None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:09.365642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd0cb-bc13-4655-91a0-cc54d5c21caa None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:09.365642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd0cb-bc13-4655-91a0-cc54d5c21caa None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:09.367024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 739/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:09.372658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87390e96-7547-46d8-8d8b-d5986906fc1d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:09.373264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87390e96-7547-46d8-8d8b-d5986906fc1d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:09.373264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87390e96-7547-46d8-8d8b-d5986906fc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:09.458646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-87390e96-7547-46d8-8d8b-d5986906fc1d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:09.459894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-87390e96-7547-46d8-8d8b-d5986906fc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:09.474994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:09.572825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 706/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:09.864595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd0cb-bc13-4655-91a0-cc54d5c21caa None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:09.866377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ea8bd0cb-bc13-4655-91a0-cc54d5c21caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:09.982338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd0cb-bc13-4655-91a0-cc54d5c21caa None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:09.996844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:10.063243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:10.063860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:10.064145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:10.064987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:10.066666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:10.190572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:10.192047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c6cbf-c2b6-4099-949a-fb26aa6417ca service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:10.213425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 740/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:12.775538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0e4de-c0d1-4338-b2e0-e2f53c4c8fea None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:12.776180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0e4de-c0d1-4338-b2e0-e2f53c4c8fea None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:12.776180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0e4de-c0d1-4338-b2e0-e2f53c4c8fea None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:12.777538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 707/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:12.784661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c606-9b3c-4c41-885e-b8c6e62dc577 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:12.785197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c606-9b3c-4c41-885e-b8c6e62dc577 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:12.785292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c606-9b3c-4c41-885e-b8c6e62dc577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:12.838942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:12.858158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3a00c606-9b3c-4c41-885e-b8c6e62dc577 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:12.859514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3a00c606-9b3c-4c41-885e-b8c6e62dc577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:12.967025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 741/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:13.282760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0e4de-c0d1-4338-b2e0-e2f53c4c8fea None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:13.285359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-99e0e4de-c0d1-4338-b2e0-e2f53c4c8fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:13.393558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0e4de-c0d1-4338-b2e0-e2f53c4c8fea None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:13.436548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:13.477954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:13.478568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:13.478862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:13.479132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:13.480744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:13.604456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:13.605951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdac58-589b-4eb7-8ed6-36f62780a016 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:13.627722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 708/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:15.728633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef37d05-e499-45f8-8fc2-c095f0c44b89 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:15.729374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef37d05-e499-45f8-8fc2-c095f0c44b89 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:15.729374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef37d05-e499-45f8-8fc2-c095f0c44b89 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:15.730644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 742/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:15.737015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6980b-b9a6-4943-b186-04a3f324c01a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:15.737530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6980b-b9a6-4943-b186-04a3f324c01a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:15.737638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6980b-b9a6-4943-b186-04a3f324c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:15.808114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9cc6980b-b9a6-4943-b186-04a3f324c01a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:15.809302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9cc6980b-b9a6-4943-b186-04a3f324c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:15.831431 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:15.911531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 709/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:16.210812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef37d05-e499-45f8-8fc2-c095f0c44b89 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:16.212475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fef37d05-e499-45f8-8fc2-c095f0c44b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:16.330472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef37d05-e499-45f8-8fc2-c095f0c44b89 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:16.353838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:16.416165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:16.416795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:16.417103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:16.417379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:16.419028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:16.554151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:16.555641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe654c-e6f0-4bab-ae2a-0693f21d32a4 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:16.575848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 743/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:18.613580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314981-2a03-4b2e-9a64-78e2cde90bee None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:18.614427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314981-2a03-4b2e-9a64-78e2cde90bee None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:18.614589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314981-2a03-4b2e-9a64-78e2cde90bee None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:18.616123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 710/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:18.621745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788110-93a4-4b9e-854a-f4a85fe4122c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:18.622200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788110-93a4-4b9e-854a-f4a85fe4122c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:18.622406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788110-93a4-4b9e-854a-f4a85fe4122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:18.693101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:18.695953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a4788110-93a4-4b9e-854a-f4a85fe4122c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:18.697234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a4788110-93a4-4b9e-854a-f4a85fe4122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:18.796968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 744/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:19.083139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314981-2a03-4b2e-9a64-78e2cde90bee None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:19.084697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-91314981-2a03-4b2e-9a64-78e2cde90bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:19.197396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314981-2a03-4b2e-9a64-78e2cde90bee None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:19.251434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:19.288840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:19.289480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:19.289764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:19.290043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:19.291721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:19.406955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:19.409091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2e0d5-9858-43a1-844e-83c1eb209474 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:19.429384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 711/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:21.570556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905392a-ed54-4fb1-8733-a6151d222f41 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:21.571171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905392a-ed54-4fb1-8733-a6151d222f41 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:21.571352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905392a-ed54-4fb1-8733-a6151d222f41 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:21.573310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 745/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:21.578880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650fb1-340e-4734-89de-5f6523055e02 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:21.579326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650fb1-340e-4734-89de-5f6523055e02 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:21.579927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650fb1-340e-4734-89de-5f6523055e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:21.653161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e0650fb1-340e-4734-89de-5f6523055e02 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:21.654405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e0650fb1-340e-4734-89de-5f6523055e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:21.686681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:21.766511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 712/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:22.058517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905392a-ed54-4fb1-8733-a6151d222f41 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.060050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4905392a-ed54-4fb1-8733-a6151d222f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:22.190685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905392a-ed54-4fb1-8733-a6151d222f41 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.220507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:22.274359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.275005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.275285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.275559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.277228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:22.391076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.392555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b852e-0880-4f09-b416-2b16279d3f35 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.416412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 746/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:24.560789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39cb5-4df9-44ec-9a0d-39b569dc1666 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.561354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39cb5-4df9-44ec-9a0d-39b569dc1666 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.561354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39cb5-4df9-44ec-9a0d-39b569dc1666 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.562734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 713/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:24.568245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9af0c-26dc-42a9-b3dc-794cf015b0ad None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.568689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9af0c-26dc-42a9-b3dc-794cf015b0ad None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.568869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9af0c-26dc-42a9-b3dc-794cf015b0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.639847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a6e9af0c-26dc-42a9-b3dc-794cf015b0ad None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:24.641196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a6e9af0c-26dc-42a9-b3dc-794cf015b0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:24.650395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:24.754373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 747/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:25.047967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39cb5-4df9-44ec-9a0d-39b569dc1666 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:25.049553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-19f39cb5-4df9-44ec-9a0d-39b569dc1666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:25.158664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39cb5-4df9-44ec-9a0d-39b569dc1666 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:25.221875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:25.241229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:25.241849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:25.242134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:25.242451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:25.244100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:25.374503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:25.375963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581915f-b3e3-49ce-94b0-5ca95a6a8906 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:25.396859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 714/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:27.437506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fa74-a1b3-48a3-b902-bc74e016701e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:27.438577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fa74-a1b3-48a3-b902-bc74e016701e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:27.438577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fa74-a1b3-48a3-b902-bc74e016701e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:27.439918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 748/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:27.445863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54900e-1268-4d5a-bfea-ace4a79d7af5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:27.446306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54900e-1268-4d5a-bfea-ace4a79d7af5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:27.446432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54900e-1268-4d5a-bfea-ace4a79d7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:27.517695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7d54900e-1268-4d5a-bfea-ace4a79d7af5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:27.518975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7d54900e-1268-4d5a-bfea-ace4a79d7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:27.564893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:27.633296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 715/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:27.913740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fa74-a1b3-48a3-b902-bc74e016701e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:27.915715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9796fa74-a1b3-48a3-b902-bc74e016701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:28.023648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fa74-a1b3-48a3-b902-bc74e016701e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:28.066514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:28.103173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:28.103699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:28.103983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:28.104257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:28.105905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:28.228303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:28.229908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10462-4c1f-48ab-9165-e49b6fc49d9c service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:28.255567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 749/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:30.333445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7778-ad2d-48cf-815c-7df71f05a13a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:30.334049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7778-ad2d-48cf-815c-7df71f05a13a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:30.334049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7778-ad2d-48cf-815c-7df71f05a13a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:30.335444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 716/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:30.341135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7fd07-ac6e-4dc3-8d5c-a818f2e98f66 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:30.341582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7fd07-ac6e-4dc3-8d5c-a818f2e98f66 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:30.341691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7fd07-ac6e-4dc3-8d5c-a818f2e98f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:30.541554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-37e7fd07-ac6e-4dc3-8d5c-a818f2e98f66 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:30.542704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-37e7fd07-ac6e-4dc3-8d5c-a818f2e98f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:30.562719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:30.646849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 750/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:30.927575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7778-ad2d-48cf-815c-7df71f05a13a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:30.929139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0ead7778-ad2d-48cf-815c-7df71f05a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:31.035794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7778-ad2d-48cf-815c-7df71f05a13a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:31.114987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:31.122828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:31.187010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:31.187010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:31.187010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:31.187010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:31.238760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:31.240569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d23c2-9eff-4694-a094-c87eb1027ff1 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:31.260049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 717/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:33.241237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f373-0843-40b9-9219-eefed59a8e01 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.241830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f373-0843-40b9-9219-eefed59a8e01 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.241830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569f373-0843-40b9-9219-eefed59a8e01 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.243139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 751/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:33.249573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f078-8f77-4b05-b701-4a42c7f30f76 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.250081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f078-8f77-4b05-b701-4a42c7f30f76 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.250540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f078-8f77-4b05-b701-4a42c7f30f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.326743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a0d3f078-8f77-4b05-b701-4a42c7f30f76 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:33.327965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a0d3f078-8f77-4b05-b701-4a42c7f30f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:33.378452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:33.432289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 718/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:33.718911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f373-0843-40b9-9219-eefed59a8e01 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.721300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e569f373-0843-40b9-9219-eefed59a8e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:33.830398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569f373-0843-40b9-9219-eefed59a8e01 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.889993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:33.918695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.947910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.947910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.947910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.947910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:34.033771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:34.035456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbf18-ee95-4d8d-8e55-6afef9867b67 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:34.054020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 752/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:43.446047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=22 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:44.128001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=66 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:55.071197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d5c32-a884-4c8f-ad95-96d211199b63 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.071753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d5c32-a884-4c8f-ad95-96d211199b63 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.071876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d5c32-a884-4c8f-ad95-96d211199b63 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.073304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 719/1471] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:55.079709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd01b-22fc-4916-9c4e-c36adf110c72 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.080412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd01b-22fc-4916-9c4e-c36adf110c72 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.080412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd01b-22fc-4916-9c4e-c36adf110c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.154650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b40dd01b-22fc-4916-9c4e-c36adf110c72 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:55.155877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b40dd01b-22fc-4916-9c4e-c36adf110c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.255943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 753/1472] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:55.558566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a2e3-cdc4-4336-9f05-d2abf7ed44db None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.558855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a2e3-cdc4-4336-9f05-d2abf7ed44db None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.559156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a2e3-cdc4-4336-9f05-d2abf7ed44db None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.560501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 720/1473] 10.222.0.76 () {54 vars in 967 bytes} [Wed Aug 31 19:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:55.566487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa829f-cfb7-4fd8-ae09-7b5bd3b3203d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.566773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa829f-cfb7-4fd8-ae09-7b5bd3b3203d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.567063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa829f-cfb7-4fd8-ae09-7b5bd3b3203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.655621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e7aa829f-cfb7-4fd8-ae09-7b5bd3b3203d None None] MFA Rules not processed for user `011b9ddf05d14d75aaa67fb395ec7312`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:55.657124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e7aa829f-cfb7-4fd8-ae09-7b5bd3b3203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.679413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:55.734544 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 754/1474] 10.222.0.76 () {58 vars in 1064 bytes} [Wed Aug 31 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:55.743542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a2e3-cdc4-4336-9f05-d2abf7ed44db None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.745796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3310a2e3-cdc4-4336-9f05-d2abf7ed44db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.865019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a2e3-cdc4-4336-9f05-d2abf7ed44db None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.939772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.940387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.940669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.940979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.942594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.998247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:56.054973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:56.056423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2240f0-84bb-4825-b761-1641d81ab47f service glance] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:56.076414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 721/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:58.153298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1920b-3f18-4258-87ca-78017ff85c42 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.153848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1920b-3f18-4258-87ca-78017ff85c42 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.153848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1920b-3f18-4258-87ca-78017ff85c42 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.155230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 755/1476] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:58.161271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbddd-8f9c-4b2e-816b-f2544b750730 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.161705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbddd-8f9c-4b2e-816b-f2544b750730 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.161814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbddd-8f9c-4b2e-816b-f2544b750730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.229867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8c3fbddd-8f9c-4b2e-816b-f2544b750730 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:58.231070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8c3fbddd-8f9c-4b2e-816b-f2544b750730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:58.332162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 722/1477] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:58.607602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1920b-3f18-4258-87ca-78017ff85c42 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.609184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-35a1920b-3f18-4258-87ca-78017ff85c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:58.744518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1920b-3f18-4258-87ca-78017ff85c42 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.802323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:58.858479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.859095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.859409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.859690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.860387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.862207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:25:58.862207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:25:58.862207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:25:58.863346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08766d5-319b-439b-b76e-f9bd40b28f92 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.885119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 756/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Wed Aug 31 19:25:58 2022] GET /identity/v3/projects => generated 2553 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:26:00.879889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033013-890a-4811-9840-65409ee4f3fe None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:00.880554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033013-890a-4811-9840-65409ee4f3fe None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:00.880554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033013-890a-4811-9840-65409ee4f3fe None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:00.881944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 723/1479] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:00.888035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532fb75-9b4d-4ee6-8819-53e929d1cb9f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:00.888585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532fb75-9b4d-4ee6-8819-53e929d1cb9f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:00.888585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532fb75-9b4d-4ee6-8819-53e929d1cb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:00.960196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8532fb75-9b4d-4ee6-8819-53e929d1cb9f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:00.961439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8532fb75-9b4d-4ee6-8819-53e929d1cb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:01.076298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 757/1480] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:01.378388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9033013-890a-4811-9840-65409ee4f3fe None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:01.380056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e9033013-890a-4811-9840-65409ee4f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:01.391157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:01.556731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9033013-890a-4811-9840-65409ee4f3fe None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:01.651725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:01.684816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:01.685439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:01.685919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:01.686251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:01.689140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:01.792059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:01.793730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2d85-8c4d-4516-8c1b-4d9ca2770779 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:01.813095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 724/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:03.951718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b911b6-3f44-4887-b9e7-fcbaba872d12 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:03.952287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b911b6-3f44-4887-b9e7-fcbaba872d12 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:03.952287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b911b6-3f44-4887-b9e7-fcbaba872d12 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:03.953759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 758/1482] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:03.959293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399733-ec1c-4adc-b0ce-174047255ad2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:03.959741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399733-ec1c-4adc-b0ce-174047255ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:03.959856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399733-ec1c-4adc-b0ce-174047255ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:04.028152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5c399733-ec1c-4adc-b0ce-174047255ad2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:04.029422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5c399733-ec1c-4adc-b0ce-174047255ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:04.077577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:04.128755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 725/1483] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:04.417853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b911b6-3f44-4887-b9e7-fcbaba872d12 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:04.419435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-92b911b6-3f44-4887-b9e7-fcbaba872d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:04.442960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:04.533531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b911b6-3f44-4887-b9e7-fcbaba872d12 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:04.611112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:04.611720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:04.612005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:04.612274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:04.613940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:04.690632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:04.726780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:04.728235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1976-27a3-403c-84ab-7bc6def8ae5a service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:04.747214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 759/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:06.744187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e9724-1db3-4508-a068-56aabf17ee6f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:06.744769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e9724-1db3-4508-a068-56aabf17ee6f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:06.744769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e9724-1db3-4508-a068-56aabf17ee6f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:06.746126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 726/1485] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:06.751443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248d4-93cc-41a3-b28c-d584061066c1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:06.754245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248d4-93cc-41a3-b28c-d584061066c1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:06.754245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248d4-93cc-41a3-b28c-d584061066c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:06.820293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c87248d4-93cc-41a3-b28c-d584061066c1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:06.821592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c87248d4-93cc-41a3-b28c-d584061066c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:06.932274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 760/1486] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:07.224682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e9724-1db3-4508-a068-56aabf17ee6f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:07.226286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f7e9724-1db3-4508-a068-56aabf17ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:07.332952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e9724-1db3-4508-a068-56aabf17ee6f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:07.406430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:07.408199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:07.409119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:07.409405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:07.409684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:07.411327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:07.525957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:07.527321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b94374-ca12-4b22-a8f8-30bbf11f644b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:07.547288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 727/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:09.561433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ef406-9a17-4607-9162-b14cd2779532 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:09.562451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ef406-9a17-4607-9162-b14cd2779532 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:09.562451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ef406-9a17-4607-9162-b14cd2779532 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:09.563866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 761/1488] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:09.569251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71653e-fe19-4bdc-8dce-99ab22091987 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:09.569691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71653e-fe19-4bdc-8dce-99ab22091987 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:09.569796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71653e-fe19-4bdc-8dce-99ab22091987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:09.636685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5f71653e-fe19-4bdc-8dce-99ab22091987 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:09.637934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5f71653e-fe19-4bdc-8dce-99ab22091987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:09.692232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:09.736230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 728/1489] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:10.026940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ef406-9a17-4607-9162-b14cd2779532 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.028575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a54ef406-9a17-4607-9162-b14cd2779532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:10.067767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:10.135172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ef406-9a17-4607-9162-b14cd2779532 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.210299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.211049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.211331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.211632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.213581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:10.298718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:10.328475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.329968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3eca6-864a-41e1-88f8-ec8ce66ac7a4 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.348653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 762/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:12.961965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e87a5-c126-4e49-866c-74b99133ff79 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:12.962581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e87a5-c126-4e49-866c-74b99133ff79 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:12.962581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e87a5-c126-4e49-866c-74b99133ff79 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:12.963882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 729/1491] 10.222.0.76 () {54 vars in 927 bytes} [Wed Aug 31 19:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:12.969673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd728d-f1f8-4cad-9543-9031641c35dd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:12.970447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd728d-f1f8-4cad-9543-9031641c35dd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:12.970638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd728d-f1f8-4cad-9543-9031641c35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:13.046637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cbbd728d-f1f8-4cad-9543-9031641c35dd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:13.047886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cbbd728d-f1f8-4cad-9543-9031641c35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:13.151162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 763/1492] 10.222.0.76 () {58 vars in 1024 bytes} [Wed Aug 31 19:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:13.440169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e87a5-c126-4e49-866c-74b99133ff79 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:13.441759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-463e87a5-c126-4e49-866c-74b99133ff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:13.554354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e87a5-c126-4e49-866c-74b99133ff79 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:13.633912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:13.634523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:13.634799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:13.635067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:13.636671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:13.646825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:13.751269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:13.752662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890dc53-adc8-4abf-980d-40bf32f8ce68 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:13.773749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 730/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:23.149295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=82 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:23.794751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=50 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:45.186711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:45.187310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:45.187415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:45.272508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:45.273762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:45.376359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 764/1494] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:45.384685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:45.385303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:45.385423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:45.465860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:45.466956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:45.571361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 731/1495] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:45.576478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:45.577729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:45.590179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f083f-d81a-4ff4-9e9b-6bfdb5699664 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:45.651279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:45.685192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:45.685802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:45.686084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:45.686356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:45.687002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:27:45.687395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:45.688511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:45.688511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:27:45.688511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:27:45.689565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:45.702229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 765/1496] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:27:45.710571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:45.720582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549b3b0-c3fa-4619-bb42-b99cf3e5f44d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:45.784284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:45.819721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:45.820335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:45.820619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:45.820923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:45.821659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:45.824063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:45.824063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:27:45.824063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:27:45.825302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:45.960764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 732/1497] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:27:45 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:27:45.965319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:45.966846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:46.003233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c61c9b-3280-409b-9741-049661523c07 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:46.101270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:46.101869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:46.102148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:46.102420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:46.103051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:46.104049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:46.104049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:27:46.104049 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:27:46.105876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:46.284400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 766/1498] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:27:45 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:27:46.288556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:46.290100 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:46.355223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f8570-7e54-4789-8805-2f4f5fca4fba admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:46.440565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:46.451401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:27:46.457011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:27:46.457599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:46.468170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 733/1499] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:27:46.472257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:46.473802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:46.485125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f241f-eac2-40f2-8ed6-c58b2539eb22 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:46.510107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:46.581070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:46.581694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:46.581980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:46.582246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:46.582882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:46.583886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:46.583886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:27:46.583886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:27:46.584763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851dff9-2ccc-4410-8aff-e9bd0f17b836 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:46.597909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 767/1500] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:27:46.602619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:46.604281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:46.638901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7643e-59a7-430a-89a3-ee0e1d170cdd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:46.735150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:46.735808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:46.736087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:46.736358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] PATH_INFO: `/v3/projects/4c982aa83feb422ab8e6938923f09d86/users/1051ef7fe2884d508f6b7a7ae81a5d40/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:46.758685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c982aa83feb422ab8e6938923f09d86, user_id=1051ef7fe2884d508f6b7a7ae81a5d40, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:46.759729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:46.759729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:27:46.759729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:27:46.761747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94150f1-61bb-416d-ae11-b81c7a21691b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:46.902490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 734/1501] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:27:46 2022] PUT /identity/v3/projects/4c982aa83feb422ab8e6938923f09d86/users/1051ef7fe2884d508f6b7a7ae81a5d40/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:27:46.914903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4ebb-7ae4-4eeb-9095-f78fcaeae531 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:46.924086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4ebb-7ae4-4eeb-9095-f78fcaeae531 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:46.924086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4ebb-7ae4-4eeb-9095-f78fcaeae531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:46.976427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b1af4ebb-7ae4-4eeb-9095-f78fcaeae531 None None] MFA Rules not processed for user `1051ef7fe2884d508f6b7a7ae81a5d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:46.977856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b1af4ebb-7ae4-4eeb-9095-f78fcaeae531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:47.057792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 768/1502] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:47.070719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40336e1b-5620-401d-b567-d704b8a71ede None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:47.071005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40336e1b-5620-401d-b567-d704b8a71ede None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:47.071280 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40336e1b-5620-401d-b567-d704b8a71ede None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:47.072618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 735/1503] 10.222.0.76 () {54 vars in 964 bytes} [Wed Aug 31 19:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:27:47.078212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85a46c-2158-453c-bf9b-971da850d672 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:47.078500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85a46c-2158-453c-bf9b-971da850d672 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:47.078815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85a46c-2158-453c-bf9b-971da850d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:47.110650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:47.157779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ea85a46c-2158-453c-bf9b-971da850d672 None None] MFA Rules not processed for user `50774a4923ce4027a7c36d9972e53e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:47.159159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ea85a46c-2158-453c-bf9b-971da850d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:47.241621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 769/1504] 10.222.0.76 () {58 vars in 1061 bytes} [Wed Aug 31 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:47.252050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40336e1b-5620-401d-b567-d704b8a71ede None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:47.253915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-40336e1b-5620-401d-b567-d704b8a71ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:47.309391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:47.362858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40336e1b-5620-401d-b567-d704b8a71ede None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:47.437942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:47.438467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:47.438746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:47.439030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:47.440673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:47.665472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:47.666931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:47.670454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:47.685609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 736/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:47.731342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca6b3-6216-47fb-8e52-6ed60797ec9c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:47.731806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca6b3-6216-47fb-8e52-6ed60797ec9c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:47.731897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca6b3-6216-47fb-8e52-6ed60797ec9c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:47.733211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 770/1506] 10.222.0.76 () {52 vars in 830 bytes} [Wed Aug 31 19:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:27:47.737148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:47.738424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:47.841075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54996-2255-4203-a86b-97a8a79fb7f6 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:47.934137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:47.934767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:47.935051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:47.935321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] PATH_INFO: `/v3/users/1051ef7fe2884d508f6b7a7ae81a5d40` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:47.949317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1051ef7fe2884d508f6b7a7ae81a5d40)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:47.950353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:47.950353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:27:47.950353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:27:47.951574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:47.961545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:48.322908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1051ef7fe2884d508f6b7a7ae81a5d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:48.324219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1051ef7fe2884d508f6b7a7ae81a5d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:48.346548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1051ef7fe2884d508f6b7a7ae81a5d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:48.361224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1051ef7fe2884d508f6b7a7ae81a5d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:48.361926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1051ef7fe2884d508f6b7a7ae81a5d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:48.850233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 737/1507] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:27:47 2022] DELETE /identity/v3/users/1051ef7fe2884d508f6b7a7ae81a5d40 => generated 0 bytes in 1114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:27:48.854793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:48.855218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:48.855399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:48.915847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:48.917106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:48.994883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:49.007808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 771/1508] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:49.018449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:49.020131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:49.129357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2df24c-4912-44c1-aa10-4f409f551b07 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:49.164706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:49.165410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:49.165725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:49.166005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:49.168642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:49.202501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:49.289419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:49.290885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c80594-2d76-479c-a3f9-3913e90a5e36 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:49.309938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 738/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:49.880120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:49.881812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:49.895403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b925fb2-1060-4c92-b597-09d456977346 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:49.901946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:49.902763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:49.903058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:49.903344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] PATH_INFO: `/v3/projects/4c982aa83feb422ab8e6938923f09d86` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:49.916967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c982aa83feb422ab8e6938923f09d86)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:49.918076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:27:49.918076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:27:49.918076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:27:49.919288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:50.093527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c982aa83feb422ab8e6938923f09d86', 'request_id': 'req-1639775a-d57b-4063-abb5-b3d6d45126b5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:50.243727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c982aa83feb422ab8e6938923f09d86', 'request_id': 'req-1639775a-d57b-4063-abb5-b3d6d45126b5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:50.258687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c982aa83feb422ab8e6938923f09d86', 'request_id': 'req-1639775a-d57b-4063-abb5-b3d6d45126b5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:50.270134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] The token cache is being invalidate because project 4c982aa83feb422ab8e6938923f09d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:27:50.270456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:50.271306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1639775a-d57b-4063-abb5-b3d6d45126b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:27:50.273004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 772/1510] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:27:49 2022] DELETE /identity/v3/projects/4c982aa83feb422ab8e6938923f09d86 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:27:59.312130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=41 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:00.266969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:32.327321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeea3e5-ee7b-492a-ab27-6e87dbd3d36b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.327905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeea3e5-ee7b-492a-ab27-6e87dbd3d36b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.327905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeea3e5-ee7b-492a-ab27-6e87dbd3d36b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.329272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 739/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:32.334210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473b76-e2cd-4d2e-ae2d-4a28dca680a7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.334649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473b76-e2cd-4d2e-ae2d-4a28dca680a7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.334749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473b76-e2cd-4d2e-ae2d-4a28dca680a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.396420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c7473b76-e2cd-4d2e-ae2d-4a28dca680a7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:32.397672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c7473b76-e2cd-4d2e-ae2d-4a28dca680a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:32.458558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 773/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:32.615183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeea3e5-ee7b-492a-ab27-6e87dbd3d36b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.616930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ddeea3e5-ee7b-492a-ab27-6e87dbd3d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:32.724855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeea3e5-ee7b-492a-ab27-6e87dbd3d36b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.730718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf2618-1804-4388-aa2a-27acbb1a9cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.731352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2618-1804-4388-aa2a-27acbb1a9cef service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.731639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2618-1804-4388-aa2a-27acbb1a9cef service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.731915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2618-1804-4388-aa2a-27acbb1a9cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.741069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf2618-1804-4388-aa2a-27acbb1a9cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.743233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf2618-1804-4388-aa2a-27acbb1a9cef service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.753421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 740/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:33.597698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2693-2400-46a8-8bb6-09abc503a0f1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.598253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2693-2400-46a8-8bb6-09abc503a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.598253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2693-2400-46a8-8bb6-09abc503a0f1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.599644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 774/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:33.605183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558d686-416e-46a5-ab3f-9a45d6607ec0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.605597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558d686-416e-46a5-ab3f-9a45d6607ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.605775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558d686-416e-46a5-ab3f-9a45d6607ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.625989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5558d686-416e-46a5-ab3f-9a45d6607ec0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:33.627189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5558d686-416e-46a5-ab3f-9a45d6607ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.634903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 741/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:33.787854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2693-2400-46a8-8bb6-09abc503a0f1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.803095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2693-2400-46a8-8bb6-09abc503a0f1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.809331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49455de4-4f31-4701-8062-73121589affd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.809941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455de4-4f31-4701-8062-73121589affd service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.810223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455de4-4f31-4701-8062-73121589affd service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.810501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455de4-4f31-4701-8062-73121589affd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.818714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49455de4-4f31-4701-8062-73121589affd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.820316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49455de4-4f31-4701-8062-73121589affd service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.830061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 775/1516] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:34.022825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5d1f1-fc27-40da-aef8-c2cd3b02106c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:34.023113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5d1f1-fc27-40da-aef8-c2cd3b02106c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:34.023389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5d1f1-fc27-40da-aef8-c2cd3b02106c None None] PATH_INFO: `/v3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:34.025285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 742/1517] 10.222.0.48 () {54 vars in 925 bytes} [Wed Aug 31 19:29:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:34.031718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321add-4ea5-451d-b728-4fd0be39328d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:34.032010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321add-4ea5-451d-b728-4fd0be39328d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:34.032290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321add-4ea5-451d-b728-4fd0be39328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:34.095832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d7321add-4ea5-451d-b728-4fd0be39328d None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:34.097091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d7321add-4ea5-451d-b728-4fd0be39328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:34.168447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 776/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 31 19:29:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:43.620948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=49 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:44.165745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:44.825308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afadf92-e88e-4df6-808a-d23022cd50c1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.825983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afadf92-e88e-4df6-808a-d23022cd50c1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.825983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afadf92-e88e-4df6-808a-d23022cd50c1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.827214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 743/1519] 10.222.0.76 () {54 vars in 961 bytes} [Wed Aug 31 19:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:44.833093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3bad-40dd-446f-83ab-c3073382341b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.833485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3bad-40dd-446f-83ab-c3073382341b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.833837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3bad-40dd-446f-83ab-c3073382341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.854402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1a9b3bad-40dd-446f-83ab-c3073382341b None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:44.856353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1a9b3bad-40dd-446f-83ab-c3073382341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:44.864790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 777/1520] 10.222.0.76 () {58 vars in 1058 bytes} [Wed Aug 31 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:44.873633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afadf92-e88e-4df6-808a-d23022cd50c1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.891872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afadf92-e88e-4df6-808a-d23022cd50c1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.897109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c47d-ae4a-4341-a349-82b91177dd9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.897746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c47d-ae4a-4341-a349-82b91177dd9d service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.898028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c47d-ae4a-4341-a349-82b91177dd9d service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.898344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c47d-ae4a-4341-a349-82b91177dd9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.907552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c47d-ae4a-4341-a349-82b91177dd9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.909172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c47d-ae4a-4341-a349-82b91177dd9d service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.920124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 744/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:45.087478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7d73-9070-434e-89bf-a5e2c3757ca1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.087690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7d73-9070-434e-89bf-a5e2c3757ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.087938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7d73-9070-434e-89bf-a5e2c3757ca1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.090046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 778/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:45.095222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452f46-1702-4c3b-bf5f-863a6bcb84af None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.095513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452f46-1702-4c3b-bf5f-863a6bcb84af None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.095791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452f46-1702-4c3b-bf5f-863a6bcb84af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.116405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4b452f46-1702-4c3b-bf5f-863a6bcb84af None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:45.117655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4b452f46-1702-4c3b-bf5f-863a6bcb84af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:45.125907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 745/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:45.283151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7d73-9070-434e-89bf-a5e2c3757ca1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.299415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7d73-9070-434e-89bf-a5e2c3757ca1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.305014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57204f-f13d-4a4f-90c3-80c74c4bc8cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.305618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57204f-f13d-4a4f-90c3-80c74c4bc8cb service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.305952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57204f-f13d-4a4f-90c3-80c74c4bc8cb service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.306233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57204f-f13d-4a4f-90c3-80c74c4bc8cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.314607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57204f-f13d-4a4f-90c3-80c74c4bc8cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.316203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57204f-f13d-4a4f-90c3-80c74c4bc8cb service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.327200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 779/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:46.199873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7198b5-04e0-4869-b9ec-9cba099842aa None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.200406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7198b5-04e0-4869-b9ec-9cba099842aa None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.200406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7198b5-04e0-4869-b9ec-9cba099842aa None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.201734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 746/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:46.207055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c0a0-df42-464d-854d-94dafc4a49be None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.207346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c0a0-df42-464d-854d-94dafc4a49be None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.207629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c0a0-df42-464d-854d-94dafc4a49be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.227997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9ec7c0a0-df42-464d-854d-94dafc4a49be None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:46.229265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9ec7c0a0-df42-464d-854d-94dafc4a49be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:46.237225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 780/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:46.393320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7198b5-04e0-4869-b9ec-9cba099842aa None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.408161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7198b5-04e0-4869-b9ec-9cba099842aa None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:46.413623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e10b9-f536-47b8-891b-e957e6aa469b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:46.414223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e10b9-f536-47b8-891b-e957e6aa469b service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.414505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e10b9-f536-47b8-891b-e957e6aa469b service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.414780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e10b9-f536-47b8-891b-e957e6aa469b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.422983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e10b9-f536-47b8-891b-e957e6aa469b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:46.424604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e10b9-f536-47b8-891b-e957e6aa469b service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.434836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 747/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:50.334040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d0ac0-ff85-45b6-93bd-6ecf0e583810 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.334630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d0ac0-ff85-45b6-93bd-6ecf0e583810 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.334630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d0ac0-ff85-45b6-93bd-6ecf0e583810 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.335938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 781/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:29:50.342069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c4ca-cf86-4849-b33a-0b8806230751 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.342490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c4ca-cf86-4849-b33a-0b8806230751 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.342601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c4ca-cf86-4849-b33a-0b8806230751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.364418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dc73c4ca-cf86-4849-b33a-0b8806230751 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:50.365672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dc73c4ca-cf86-4849-b33a-0b8806230751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:50.374188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 748/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:50.669990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d0ac0-ff85-45b6-93bd-6ecf0e583810 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:50.671735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1d3d0ac0-ff85-45b6-93bd-6ecf0e583810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:50.754120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d0ac0-ff85-45b6-93bd-6ecf0e583810 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:50.757981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57891a3-1131-4c9f-a7e2-3c2a944bdeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:50.758602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57891a3-1131-4c9f-a7e2-3c2a944bdeaa service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.758888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57891a3-1131-4c9f-a7e2-3c2a944bdeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.759165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57891a3-1131-4c9f-a7e2-3c2a944bdeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.769112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57891a3-1131-4c9f-a7e2-3c2a944bdeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:50.770588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57891a3-1131-4c9f-a7e2-3c2a944bdeaa service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:50.780565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 782/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:52.717372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11245d7-a640-4698-a6e0-a1ee467dc3b9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.717944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11245d7-a640-4698-a6e0-a1ee467dc3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.717944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11245d7-a640-4698-a6e0-a1ee467dc3b9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.719265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 749/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:52.724719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e87c9-b19e-4aa0-b14b-6c8cce79688c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.725173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e87c9-b19e-4aa0-b14b-6c8cce79688c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.725319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e87c9-b19e-4aa0-b14b-6c8cce79688c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.744987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6a5e87c9-b19e-4aa0-b14b-6c8cce79688c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:52.746234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a5e87c9-b19e-4aa0-b14b-6c8cce79688c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.754249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 783/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:53.048271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11245d7-a640-4698-a6e0-a1ee467dc3b9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.050005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c11245d7-a640-4698-a6e0-a1ee467dc3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.063652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11245d7-a640-4698-a6e0-a1ee467dc3b9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.067239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef32d9-0100-444b-b7dc-532c1f2bae14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.067831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef32d9-0100-444b-b7dc-532c1f2bae14 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.068108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef32d9-0100-444b-b7dc-532c1f2bae14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.068379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef32d9-0100-444b-b7dc-532c1f2bae14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.079628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef32d9-0100-444b-b7dc-532c1f2bae14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.081170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef32d9-0100-444b-b7dc-532c1f2bae14 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.090400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 750/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:56.675393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e9854-0590-4208-a6b8-ba150a1eba37 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:56.675995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e9854-0590-4208-a6b8-ba150a1eba37 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:56.675995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e9854-0590-4208-a6b8-ba150a1eba37 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:56.677367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 784/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:56.683499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2b3c-442d-44e3-8611-ddc29ed9648c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:56.683968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2b3c-442d-44e3-8611-ddc29ed9648c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:56.684074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2b3c-442d-44e3-8611-ddc29ed9648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:56.704082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1e5a2b3c-442d-44e3-8611-ddc29ed9648c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:56.705355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e5a2b3c-442d-44e3-8611-ddc29ed9648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:56.713325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 751/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:57.280240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e9854-0590-4208-a6b8-ba150a1eba37 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.281998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ee3e9854-0590-4208-a6b8-ba150a1eba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.364093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e9854-0590-4208-a6b8-ba150a1eba37 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:57.367895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87e6c-a2b9-4ce0-978b-8a87641ea14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:57.368509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87e6c-a2b9-4ce0-978b-8a87641ea14a service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.368796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87e6c-a2b9-4ce0-978b-8a87641ea14a service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.369144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87e6c-a2b9-4ce0-978b-8a87641ea14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.380950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87e6c-a2b9-4ce0-978b-8a87641ea14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:57.382250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87e6c-a2b9-4ce0-978b-8a87641ea14a service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:57.392220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 785/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:59.348355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1f93-d1cd-404a-b6f9-75543463a7f7 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.349220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1f93-d1cd-404a-b6f9-75543463a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.349220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1f93-d1cd-404a-b6f9-75543463a7f7 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.350331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 752/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:29:59.356235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c0c1-fc21-4fc7-8d59-499eb4042907 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.356847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c0c1-fc21-4fc7-8d59-499eb4042907 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.356847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c0c1-fc21-4fc7-8d59-499eb4042907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.376468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2b77c0c1-fc21-4fc7-8d59-499eb4042907 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:59.377745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2b77c0c1-fc21-4fc7-8d59-499eb4042907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.386208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 786/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:59.955919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba1f93-d1cd-404a-b6f9-75543463a7f7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.957802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4aba1f93-d1cd-404a-b6f9-75543463a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.973515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba1f93-d1cd-404a-b6f9-75543463a7f7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.977147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ace46-47a7-4646-9c67-396f83051497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.977747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ace46-47a7-4646-9c67-396f83051497 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.978028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ace46-47a7-4646-9c67-396f83051497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.978300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ace46-47a7-4646-9c67-396f83051497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.987884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ace46-47a7-4646-9c67-396f83051497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.989351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ace46-47a7-4646-9c67-396f83051497 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.999691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 753/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:09.371525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=84 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:09.995445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=33 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:30.191812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.192703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.192703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.227205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:30.230013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:30.251525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 787/1540] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:30.261589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.262457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.262457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.297870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:30.300957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:30.313030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 754/1541] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:30.318573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:30.348320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e380ac-1ea3-4484-bc9b-4ea74574f8e3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:30.365279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:30.366504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.366968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.367457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.368928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:30.369469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:30.372543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ddb19-a7e5-42dd-a135-9ce98be291c1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.399114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 788/1542] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:30.410547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:30.439137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd240e8-82ee-4d50-916e-eb4139f7df63 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:30.449654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055249-40d9-494d-adcc-3de7d3d6108b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.458366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055249-40d9-494d-adcc-3de7d3d6108b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.458366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055249-40d9-494d-adcc-3de7d3d6108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.458613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:30.458613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.458613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.458973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.459843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:30.461820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.505151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-be055249-40d9-494d-adcc-3de7d3d6108b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:30.506679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-be055249-40d9-494d-adcc-3de7d3d6108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:30.527803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 789/1543] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:30.540122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.540466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.544671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.592946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:30.594678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:30.607576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 790/1544] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:30.612477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:30.627796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5415-ae71-47ec-bab5-3a9c903be769 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:30.644942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:30.646173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.646723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.647266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.648324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:30.648869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:30.651697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.653089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 755/1545] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/projects => generated 393 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:30.662151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:30.675727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 791/1546] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:31:30.687416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:30.709821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bdf66-26ff-4406-b462-fa5452ceb57d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:30.765659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b393463-ec34-4e1d-b671-82ab63a98ad4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:30.779813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:30.780449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.780733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.781086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.781817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:30.782867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:31:30.782867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:31:30.782867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:31:30.784091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c8c83-440b-4d3a-8916-7aee2cf34d73 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.854573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:30.855125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.855412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.855948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.857021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:30.859267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:31:30.859267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:31:30.859267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:31:30.861745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.911882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 756/1547] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:31:30.913427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530921b7-6e8d-4879-ab66-b891774cbd69 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.913720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530921b7-6e8d-4879-ab66-b891774cbd69 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.914044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530921b7-6e8d-4879-ab66-b891774cbd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.941520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-530921b7-6e8d-4879-ab66-b891774cbd69 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:30.943021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-530921b7-6e8d-4879-ab66-b891774cbd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:30.954584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 757/1548] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:30.962924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196810-4c79-4f40-a17c-516cd9d77537 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.962924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196810-4c79-4f40-a17c-516cd9d77537 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.962924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196810-4c79-4f40-a17c-516cd9d77537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.982429 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-aa196810-4c79-4f40-a17c-516cd9d77537 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:30.983678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aa196810-4c79-4f40-a17c-516cd9d77537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:30.993216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 758/1549] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:30.996197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b615aa-1d7b-4eeb-b9dd-ac0a61c2627c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.996197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b615aa-1d7b-4eeb-b9dd-ac0a61c2627c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.996197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b615aa-1d7b-4eeb-b9dd-ac0a61c2627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.023676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-34b615aa-1d7b-4eeb-b9dd-ac0a61c2627c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.026130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-34b615aa-1d7b-4eeb-b9dd-ac0a61c2627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.031158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 792/1550] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/projects => generated 379 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:31.032768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.136522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 759/1551] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.136522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ab98d-c8bb-48d5-be21-33ca793411cd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.136522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ab98d-c8bb-48d5-be21-33ca793411cd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.136522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ab98d-c8bb-48d5-be21-33ca793411cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.178405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bf7ab98d-c8bb-48d5-be21-33ca793411cd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.180576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bf7ab98d-c8bb-48d5-be21-33ca793411cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.184065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79807f-2aff-473a-a5d8-d9db778bc836 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.192388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71d53c-c7b4-4875-9201-f5c4e23d1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.193542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d53c-c7b4-4875-9201-f5c4e23d1a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.193962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d53c-c7b4-4875-9201-f5c4e23d1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.194231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d53c-c7b4-4875-9201-f5c4e23d1a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.195196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d53c-c7b4-4875-9201-f5c4e23d1a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.201255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 760/1552] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.201513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d53c-c7b4-4875-9201-f5c4e23d1a2f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.201661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.201661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.201661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.219421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 793/1553] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:31.221903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e30c-414d-4ae2-806e-cbe37cf9c88c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.222102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e30c-414d-4ae2-806e-cbe37cf9c88c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.222700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e30c-414d-4ae2-806e-cbe37cf9c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.229374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.230865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.239645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 761/1554] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.244057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.252219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9d9c-0222-4a49-9b2e-f834c6021750 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.252965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ef97e30c-414d-4ae2-806e-cbe37cf9c88c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.254894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ef97e30c-414d-4ae2-806e-cbe37cf9c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.257657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.258292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.258573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.259405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.260021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.263002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.267285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 794/1555] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.267285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80e32-9659-4195-9925-cc6a79afdc02 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.267285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80e32-9659-4195-9925-cc6a79afdc02 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.267285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80e32-9659-4195-9925-cc6a79afdc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.290046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-87c80e32-9659-4195-9925-cc6a79afdc02 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.291830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-87c80e32-9659-4195-9925-cc6a79afdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.300494 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 795/1556] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.302723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.303239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.303693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.333523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.334859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.344291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 796/1557] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.345903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.359207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c542-f01a-45b0-ab55-1b8a24ff1172 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.364492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.365199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.365549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.365826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.366577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:31.366925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.368638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd48973-e10b-4ced-8c73-be7bb1dc3ef0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.390389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 797/1558] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:31.391799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.392147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.392497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.401979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:31.415865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.417219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.426575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 798/1559] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.427989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.444842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bd08c-be21-4812-b2e1-e1aa35091a2c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.452175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e8aa-2d06-4d70-9186-fc66529b218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.452872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e8aa-2d06-4d70-9186-fc66529b218d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.453161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e8aa-2d06-4d70-9186-fc66529b218d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.453448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e8aa-2d06-4d70-9186-fc66529b218d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.454143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e8aa-2d06-4d70-9186-fc66529b218d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.455808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e8aa-2d06-4d70-9186-fc66529b218d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.469391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 799/1560] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:31.470946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.471439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.471731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.495778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.497119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.505616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 800/1561] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.506539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.520676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110f4c-4e74-45de-a091-b1ba00cc8f54 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.529237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.530175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.530633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.531082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.532018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:31.532331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.535243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07a7be-f799-4282-8253-372a83820c61 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.557378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 801/1562] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:31.560276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e0658-2250-485c-804b-a72edc501dbe None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.560595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e0658-2250-485c-804b-a72edc501dbe None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.560920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e0658-2250-485c-804b-a72edc501dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.585429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-213e0658-2250-485c-804b-a72edc501dbe None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.586668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-213e0658-2250-485c-804b-a72edc501dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.595418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 802/1563] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.596439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e0658-2250-485c-804b-a72edc501dbe None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.606589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e0658-2250-485c-804b-a72edc501dbe None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.611649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.612264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.612544 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.612843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.613511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:31.613814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.615538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.631020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 803/1564] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:31.631020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.643103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e985b40-d292-4ef6-ad77-4dcfd7ee2fdd admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.647301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a633e0-466b-48b3-9a3f-cf92c268b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.648124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a633e0-466b-48b3-9a3f-cf92c268b60d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.648404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a633e0-466b-48b3-9a3f-cf92c268b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.648672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a633e0-466b-48b3-9a3f-cf92c268b60d admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.650651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a633e0-466b-48b3-9a3f-cf92c268b60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.652921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a633e0-466b-48b3-9a3f-cf92c268b60d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.824820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 804/1565] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:31.828224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.828224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.828224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.852166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.853515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.891194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 762/1566] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/users => generated 290 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:31.895112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.910675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f87ea9-bd38-4669-951a-ddd74933ad3f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.916516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:31.934139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 805/1567] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.935331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.950922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7700ca-1e03-4439-ae67-04624fe931d5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.957426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.958286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.958680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.959058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.959977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:31.960387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.963001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.986958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 806/1568] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:31.988264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.988509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.989326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.989763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.990193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] PATH_INFO: `/v3/projects/7ee49d8521194e41a5229fe104739d1b/users/69684b11ca0c4af08d081da48b898115/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.005626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f5992-5647-44f1-9b49-7cb40bdf29aa admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.012382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.013675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.014251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee49d8521194e41a5229fe104739d1b, user_id=69684b11ca0c4af08d081da48b898115, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.014377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.014571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.015765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.019387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.019802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.305554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 763/1569] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:31 2022] PUT /identity/v3/projects/7ee49d8521194e41a5229fe104739d1b/users/69684b11ca0c4af08d081da48b898115/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:32.307218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.354366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 807/1570] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/projects => generated 385 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:32.354366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.388494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e3ea-21a4-494e-9ebd-3ab09923ab1f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.412535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:32.427081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f7226-2437-49f7-90ed-98cb7faaf451 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.432601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.433254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.433538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.433811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.434522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.436454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.459501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.463258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.463258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.463258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.463258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:32.463258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.463866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:31:32.463866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:31:32.463866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:31:32.463866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.476577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 764/1571] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:32.478516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.488960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af25e-12f8-4a1a-81bc-80a47e5b0fb3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.494463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.495082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.495360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.495629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.496272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.498336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.738752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 808/1572] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:32.739641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.815769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 765/1573] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:32.816711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.824038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa5979-ee5b-455a-be86-465f875b6ccb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.829592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662b755-3102-470e-b5f6-62811b4c83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.830627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662b755-3102-470e-b5f6-62811b4c83c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.831091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662b755-3102-470e-b5f6-62811b4c83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.831219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab444974-2bed-4e92-9228-406cb5e07676 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.831519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662b755-3102-470e-b5f6-62811b4c83c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.832383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662b755-3102-470e-b5f6-62811b4c83c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.835288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662b755-3102-470e-b5f6-62811b4c83c2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.836302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.837455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.837773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.838048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.838794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:32.839103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.840770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.861113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 766/1575] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:32.861372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 809/1575] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:32.861554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.861730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.861730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.861730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.866441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:32.872595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f05528-a958-4e56-8147-4cdef6645cdd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.877578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.878262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.878541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.879133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.879955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.881964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.883473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:32.884749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:32.895045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 810/1576] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:32.895900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.912752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db5806-91db-43c0-83cd-4469068b92e2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.918279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.918938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.919225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.919500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.920140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.922129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.170405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 767/1577] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/projects => generated 363 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:33.171371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.226737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 811/1578] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:33.228567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.242888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323888a-ee61-4f54-880c-b7b56a0c2d66 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.250698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.251731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.252236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.252698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.253768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.256384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac74de-aab5-4cca-b4c6-c67a7f7c62a5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.257301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.263617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.264428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.264828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.265229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.266286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.269546 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.436532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 812/1579] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:33 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:33.439098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.450597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79141ed-2dd7-42be-944d-2224a8b932b8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.456040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.456657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.456992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.457282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.457982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.459670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.470618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 813/1580] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:33.471431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.490543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81457ab-3c41-4d60-8fb8-988f432c9b06 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.499184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.499806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.500117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.500480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.501119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.502738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.503632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 768/1581] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:33 2022] POST /identity/v3/projects => generated 387 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:33.504576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.514397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 814/1582] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:33.515954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.578016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7598-3b08-4c94-9061-547a9609e6db admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.583216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.583841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.584282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.584566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.585255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.587886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.609241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227413d-eed6-4344-a4f7-1f9de1e28cdf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.644042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:33.678354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.679069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.679349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.679623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.689984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.691383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.699979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 769/1583] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:33 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:33.700651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.702392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 815/1584] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:33.703111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.714248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d610138-bc6f-4402-8f86-d7060855fc93 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.761217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:33.773179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314582-190f-48b2-9b97-d9eba57703d7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.779292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.784477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.784477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.784477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.784477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.784477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.798754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.799452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.799756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.800041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.800701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.802464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.813869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 816/1585] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:33.814722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.826087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061592db-5baa-4805-b754-b3fbe68770bc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.831242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.831900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.832185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.832465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.833163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.834793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.848270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 817/1586] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:33.849932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.861623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7d16-60e6-4187-aa97-9eaaf724c29d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.866337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.866960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.867238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.867509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.868203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.870100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.885043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 818/1587] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:33.885043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.893497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb5866-f891-46c4-938a-fbf9f5410e88 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.901358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.904827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.904827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.904827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.904827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.905961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.934501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 770/1588] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:33 2022] POST /identity/v3/users => generated 282 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:33.935230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.945926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06d5e6-cc0c-4478-83b2-610465a090f8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.950851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.951529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.951817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.952097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] PATH_INFO: `/v3/projects/e005639c51ec4228a21a3a2a3fb56519/users/c80a3e49a7cc420ab6709b0f2c54c079/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.968324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e005639c51ec4228a21a3a2a3fb56519, user_id=c80a3e49a7cc420ab6709b0f2c54c079, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.971119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.101574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 819/1589] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:33 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:34.102443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.112981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a270f15-313b-467c-ac15-5149b25882dc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.117773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.118385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.118667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.118943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.119581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.121553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.143144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 771/1590] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:33 2022] PUT /identity/v3/projects/e005639c51ec4228a21a3a2a3fb56519/users/c80a3e49a7cc420ab6709b0f2c54c079/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:34.145492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.225734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89e673-4756-4260-acfe-29e21b022685 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.233079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.234066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.234538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.235010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.236124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.239154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.243210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 820/1591] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:34 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:34.245125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.258050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 772/1592] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.260124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.269541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13bd14-9746-48c3-afa9-ec0e90275e25 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.276425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2eaf-eb8b-42eb-a201-eaf785f9b457 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.276946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.277936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.278323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.278696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.279587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.281688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.282297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.282468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.282737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.283016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] PATH_INFO: `/v3/projects/0c176bad9eb64562a480dd290f053f59/users/5d72d15d3d7848baaba2968bb4a16ebb/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.300474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 821/1593] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.313964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.314189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c176bad9eb64562a480dd290f053f59, user_id=5d72d15d3d7848baaba2968bb4a16ebb, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.316190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.320426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859612a-eda7-451d-a27a-754f21dc6b2d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.326909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.327522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.327807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.328083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.328759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.330444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.342040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 822/1594] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.342925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.353016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f09c-f992-4a02-8a0f-d2c0a5e273c3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.358152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138236ba-579b-4944-9a10-9a491a965108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.358743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138236ba-579b-4944-9a10-9a491a965108 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.359157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138236ba-579b-4944-9a10-9a491a965108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.359443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138236ba-579b-4944-9a10-9a491a965108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.360084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138236ba-579b-4944-9a10-9a491a965108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.361730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138236ba-579b-4944-9a10-9a491a965108 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.373201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 823/1595] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.374410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.374909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.375186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.395669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:34.396932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:34.405327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 824/1596] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:34.406176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.416676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521158f-017b-4c56-9531-e5a4c9334c52 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.422516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.423170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.423448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.423722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.424378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.426156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.437536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 825/1597] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.438358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.451146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83603311-7269-4548-aad9-797d7d2ea8c8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.456277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.457093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.457473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.457853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] PATH_INFO: `/v3/projects/f3767bf3aa7943c085a5daf9f310bcba/users/bec99c3414d44b85981e0122b0b4aa53/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.470134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.474551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3767bf3aa7943c085a5daf9f310bcba, user_id=bec99c3414d44b85981e0122b0b4aa53, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.475596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:31:34.475596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:31:34.475596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:31:34.477572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.535597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 773/1598] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:34 2022] PUT /identity/v3/projects/0c176bad9eb64562a480dd290f053f59/users/5d72d15d3d7848baaba2968bb4a16ebb/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:34.541450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.629494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf7e7f-1928-4ce4-a1c5-4ad4fb40de15 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.637112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 826/1599] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:34 2022] PUT /identity/v3/projects/f3767bf3aa7943c085a5daf9f310bcba/users/bec99c3414d44b85981e0122b0b4aa53/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:34.638194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.682427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.720270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80df4f-37e3-437a-8ce1-43f7c5e7cc1e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.722237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.723518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.724448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.724711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] PATH_INFO: `/v3/projects/2de8ee2ecd054928b81ee67ab36fbb3c/users/59c3ee8c88244f6a911ada7a31e24e29/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.729278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.730800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.730800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.730800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.731705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.733380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.747029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 827/1600] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.749303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.752296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de8ee2ecd054928b81ee67ab36fbb3c, user_id=59c3ee8c88244f6a911ada7a31e24e29, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.755198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.765851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300f9a-404d-49da-a6b9-997cd6b2009f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.770935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.771559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.771838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.772115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.773127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.775321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.786819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 828/1601] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.787884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.847788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c4fe-c63e-435a-86fb-5787e0d712ac admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.851985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.852645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.852965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.853238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.862922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.864368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.875387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 829/1602] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:34.876627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.891166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b6b1-3c7a-40c0-b2a5-534f30075aa5 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:34.898791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ecf8e-92ff-4728-942c-2cbe3494f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:34.900658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ecf8e-92ff-4728-942c-2cbe3494f012 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.901062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ecf8e-92ff-4728-942c-2cbe3494f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.901466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ecf8e-92ff-4728-942c-2cbe3494f012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.902643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ecf8e-92ff-4728-942c-2cbe3494f012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:34.905622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ecf8e-92ff-4728-942c-2cbe3494f012 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:34.917530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 830/1603] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:34.918770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef964-a9dc-48c9-939a-e4a03aa01808 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.919058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef964-a9dc-48c9-939a-e4a03aa01808 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.919335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef964-a9dc-48c9-939a-e4a03aa01808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.939312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-939ef964-a9dc-48c9-939a-e4a03aa01808 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:34.940543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-939ef964-a9dc-48c9-939a-e4a03aa01808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:34.950358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 831/1604] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:34.952538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:34.953067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:34.953558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:34.988020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:34.988020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:34.988020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 832/1605] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:34.988020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:34.997501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92919e2-2a58-4994-aecc-3503ea8bd462 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:35.003009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:35.003776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.003990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.004246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] PATH_INFO: `/v3/projects/3a9451c6c4fc4c2e93bb649707635778/users/8f59d75fa3944e85b93777259c664686/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.020972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9451c6c4fc4c2e93bb649707635778, user_id=8f59d75fa3944e85b93777259c664686, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:35.023667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:35.103497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 774/1606] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:34 2022] PUT /identity/v3/projects/2de8ee2ecd054928b81ee67ab36fbb3c/users/59c3ee8c88244f6a911ada7a31e24e29/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:35.104433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:35.187425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0954d-9856-4760-89a7-ee23d270a13e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:35.192992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:35.194120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.194403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.194679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] PATH_INFO: `/v3/projects/0462d5672bf9479eb616fb5055e37b3e/users/76a42ecd5a0b4058ab1192e8a019e087/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.217950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0462d5672bf9479eb616fb5055e37b3e, user_id=76a42ecd5a0b4058ab1192e8a019e087, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:35.220993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:35.257395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 833/1607] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:34 2022] PUT /identity/v3/projects/3a9451c6c4fc4c2e93bb649707635778/users/8f59d75fa3944e85b93777259c664686/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:35.257395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:35.308937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:35.344299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7897-f7ea-48d2-99be-fa4fc31dd3ec admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:35.349345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:35.350011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.350304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.350582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] PATH_INFO: `/v3/projects/d7c9f4aaf944450396a9380a72cbbe56/users/54ea9c76fa6b40e8be5bca407a886d71/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.371068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c9f4aaf944450396a9380a72cbbe56, user_id=54ea9c76fa6b40e8be5bca407a886d71, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:35.373878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:35.511104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 775/1608] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:35 2022] PUT /identity/v3/projects/0462d5672bf9479eb616fb5055e37b3e/users/76a42ecd5a0b4058ab1192e8a019e087/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:35.511971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:35.563127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 834/1609] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:35 2022] PUT /identity/v3/projects/d7c9f4aaf944450396a9380a72cbbe56/users/54ea9c76fa6b40e8be5bca407a886d71/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:35.566576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:35.597295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7cf47-b624-4842-a534-5d251023ae9a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:35.665952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadb114-34ab-476f-82e8-6fa404ee6cde admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:35.676779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c0599-6263-4dfd-ab1b-c713f0757a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:35.678131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c0599-6263-4dfd-ab1b-c713f0757a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.678575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c0599-6263-4dfd-ab1b-c713f0757a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.678953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c0599-6263-4dfd-ab1b-c713f0757a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.685108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c924260-cdbf-4ba8-bff6-4ee88822dcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:35.685973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924260-cdbf-4ba8-bff6-4ee88822dcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.686469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924260-cdbf-4ba8-bff6-4ee88822dcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.686892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924260-cdbf-4ba8-bff6-4ee88822dcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.702980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:35.764434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c924260-cdbf-4ba8-bff6-4ee88822dcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:35.766148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c924260-cdbf-4ba8-bff6-4ee88822dcb7 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:35.769087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c0599-6263-4dfd-ab1b-c713f0757a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:35.770639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c0599-6263-4dfd-ab1b-c713f0757a69 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:35.780832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 776/1610] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:35.783070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cac21b-ae06-4523-83d1-c5d5b11e7a83 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.783649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cac21b-ae06-4523-83d1-c5d5b11e7a83 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.784180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cac21b-ae06-4523-83d1-c5d5b11e7a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.790755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 835/1611] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:35.790755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d851-f0f1-41fb-9b71-cf8908a9c42f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.790755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d851-f0f1-41fb-9b71-cf8908a9c42f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.790755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d851-f0f1-41fb-9b71-cf8908a9c42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.828787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-92cac21b-ae06-4523-83d1-c5d5b11e7a83 None None] MFA Rules not processed for user `59c3ee8c88244f6a911ada7a31e24e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:35.832789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-92cac21b-ae06-4523-83d1-c5d5b11e7a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:35.838550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3933d851-f0f1-41fb-9b71-cf8908a9c42f None None] MFA Rules not processed for user `8f59d75fa3944e85b93777259c664686`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:35.842522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3933d851-f0f1-41fb-9b71-cf8908a9c42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:35.937655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 836/1612] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:35.943219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.943658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.944072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.944975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 777/1613] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:35.961207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7244a2-0488-423c-a9c1-405fad403cad None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:35.964868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7244a2-0488-423c-a9c1-405fad403cad None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:35.966184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7244a2-0488-423c-a9c1-405fad403cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:35.973242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:35.974491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:35.991759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 837/1614] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:35.993114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.019894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929c78-985a-4ca5-90ae-42950413e65f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.035792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cffdeb-752b-4c0a-ac94-231428f398a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.036301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffdeb-752b-4c0a-ac94-231428f398a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.036755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffdeb-752b-4c0a-ac94-231428f398a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.037010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffdeb-752b-4c0a-ac94-231428f398a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.037573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cffdeb-752b-4c0a-ac94-231428f398a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.039557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cffdeb-752b-4c0a-ac94-231428f398a0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.045013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0d7244a2-0488-423c-a9c1-405fad403cad None None] MFA Rules not processed for user `54ea9c76fa6b40e8be5bca407a886d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:36.046161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0d7244a2-0488-423c-a9c1-405fad403cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:36.159275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 778/1615] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:36.168784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c410-dfd8-4df0-b875-82d1fee25415 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.169109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c410-dfd8-4df0-b875-82d1fee25415 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.169388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c410-dfd8-4df0-b875-82d1fee25415 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.171360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 779/1616] 10.222.0.76 () {54 vars in 962 bytes} [Wed Aug 31 19:31:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:31:36.172135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536c410-dfd8-4df0-b875-82d1fee25415 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.187521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536c410-dfd8-4df0-b875-82d1fee25415 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.194241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.194871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.195153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.195444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.211242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.212017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 838/1617] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:35 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:36.214976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.215113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15299-7f05-411d-84d7-49882f7bf32b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.215113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15299-7f05-411d-84d7-49882f7bf32b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.217503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d15299-7f05-411d-84d7-49882f7bf32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.249602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 780/1618] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:36.251190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.266126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f177f1-f114-4b79-92f8-326656ccc808 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.291065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c7d15299-7f05-411d-84d7-49882f7bf32b None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:36.292425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c7d15299-7f05-411d-84d7-49882f7bf32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:36.355782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.826692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.826692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.826692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.826692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.826692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.828654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 839/1619] 10.222.0.76 () {58 vars in 1059 bytes} [Wed Aug 31 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:36.828654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7d78d-e266-455f-ab4f-0a391fef4930 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.828654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7d78d-e266-455f-ab4f-0a391fef4930 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.828654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7d78d-e266-455f-ab4f-0a391fef4930 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.828654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 840/1620] 10.222.0.76 () {54 vars in 962 bytes} [Wed Aug 31 19:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:31:36.828654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7d78d-e266-455f-ab4f-0a391fef4930 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.829861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7d78d-e266-455f-ab4f-0a391fef4930 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.829861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0457a-8700-4172-b03b-d8c39e769f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.829861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0457a-8700-4172-b03b-d8c39e769f32 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.829861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0457a-8700-4172-b03b-d8c39e769f32 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.830533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0457a-8700-4172-b03b-d8c39e769f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.830533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0457a-8700-4172-b03b-d8c39e769f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.830533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0457a-8700-4172-b03b-d8c39e769f32 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.830533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 841/1621] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:36.830533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.830533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.831172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.831172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:36.831172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:36.831172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 842/1622] 10.222.0.76 () {58 vars in 1059 bytes} [Wed Aug 31 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:36.831172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.831172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87677f1-1341-45de-a90d-b05e74e50902 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.831888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:36.832314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 781/1623] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:36 2022] POST /identity/v3/users => generated 288 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:36.832314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.832700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1383af-3a73-4aa5-bc7c-4e9ed9473aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.832700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1383af-3a73-4aa5-bc7c-4e9ed9473aa4 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.832700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1383af-3a73-4aa5-bc7c-4e9ed9473aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.832700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1383af-3a73-4aa5-bc7c-4e9ed9473aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.833260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addffa6e-fa6d-42e0-81ca-93fe4d5889dd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.833260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.833260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.833260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.833785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.833785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.833785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.833785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 782/1624] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:36.833785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:36.834146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1383af-3a73-4aa5-bc7c-4e9ed9473aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.834146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1383af-3a73-4aa5-bc7c-4e9ed9473aa4 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.837497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 843/1625] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:36.860257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c906-ccf7-4f06-8d32-29076f103caa admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:36.876435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:36.877423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.877786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.877994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] PATH_INFO: `/v3/projects/5f613e371c5e46518c752536f6c7e692/users/010f2baf51484e7e8d715918d6b8794c/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.919479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f613e371c5e46518c752536f6c7e692, user_id=010f2baf51484e7e8d715918d6b8794c, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:36.923824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:36.976899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cebad-ac79-45af-9378-3dadb1422bce None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.977201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cebad-ac79-45af-9378-3dadb1422bce None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.977986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cebad-ac79-45af-9378-3dadb1422bce None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:36.979530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 844/1626] 10.222.0.76 () {54 vars in 912 bytes} [Wed Aug 31 19:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:31:36.985687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:36.985981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:36.986854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.016570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:37.017905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:37.033415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 845/1627] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:37.051801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:37.141178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032b5e-da43-4407-87da-c1cdd7e94fea None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:37.145902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a90f3-24dd-4c27-ac8a-5caa6ee5c380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:37.146800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a90f3-24dd-4c27-ac8a-5caa6ee5c380 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.147607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a90f3-24dd-4c27-ac8a-5caa6ee5c380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.147607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a90f3-24dd-4c27-ac8a-5caa6ee5c380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.162007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a90f3-24dd-4c27-ac8a-5caa6ee5c380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:37.163858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a90f3-24dd-4c27-ac8a-5caa6ee5c380 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:37.178576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 846/1628] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:31:37.181814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9067-d019-48fd-b506-deafb9754045 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.182851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9067-d019-48fd-b506-deafb9754045 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.183131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9067-d019-48fd-b506-deafb9754045 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.187408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 783/1629] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:36 2022] PUT /identity/v3/projects/5f613e371c5e46518c752536f6c7e692/users/010f2baf51484e7e8d715918d6b8794c/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:37.189279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 847/1630] 10.222.0.76 () {54 vars in 912 bytes} [Wed Aug 31 19:31:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:31:37.189386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:37.190722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.191013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.191302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.217962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:37.219743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:37.341628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fddff-1a3c-42df-8a48-7a00779573ca admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:37.357496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:37.358705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 848/1631] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:37.359463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.359756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.360037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.360836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:37.363096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:37.383231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 784/1632] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:31:37.385218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:37.397383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:37.417330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33998-b111-457b-9279-b09e9c6338f5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:37.423290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199e0cc-1f05-46aa-a749-0928293e2ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:37.423983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e0cc-1f05-46aa-a749-0928293e2ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.424267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e0cc-1f05-46aa-a749-0928293e2ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.424543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e0cc-1f05-46aa-a749-0928293e2ef9 admin admin] PATH_INFO: `/v3/projects/5f613e371c5e46518c752536f6c7e692/users/010f2baf51484e7e8d715918d6b8794c/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.426580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199e0cc-1f05-46aa-a749-0928293e2ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f613e371c5e46518c752536f6c7e692, user_id=010f2baf51484e7e8d715918d6b8794c, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:37.429987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199e0cc-1f05-46aa-a749-0928293e2ef9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:37.445461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 785/1633] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:37 2022] PUT /identity/v3/projects/5f613e371c5e46518c752536f6c7e692/users/010f2baf51484e7e8d715918d6b8794c/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:37.457191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.460703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.460879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.506252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a76491-eefe-4bdf-8962-1a3aa26fc7a4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:37.738204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] MFA Rules not processed for user `010f2baf51484e7e8d715918d6b8794c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:37.738204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:37.738647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:37.738647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:37.738647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:37.738647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:37.738980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 786/1634] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:37.757135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:37.759370 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:37.779848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 849/1635] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:38.703745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:39.098390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:39.110637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600586d4-62cd-4d4c-ae79-73a9e92d5052 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:39.121437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:39.122094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:39.122852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:39.122852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:39.138654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:39.140167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:39.167309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 787/1636] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:39.907787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:39.922033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49388-1ece-441d-a806-064c268f124c service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:39.930142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d22a-8479-415a-bc95-4c827c92340a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:39.931507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d22a-8479-415a-bc95-4c827c92340a service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:39.932089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d22a-8479-415a-bc95-4c827c92340a service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:39.932472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d22a-8479-415a-bc95-4c827c92340a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:40.012374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:40.079613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d22a-8479-415a-bc95-4c827c92340a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:40.081229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d22a-8479-415a-bc95-4c827c92340a service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:40.095432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 850/1637] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:41.632846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:44.545984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:45.006513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:45.244307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780cd0-979f-4672-9917-66dfebf0fbd7 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:45.252734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:45.261115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:45.261901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:45.262391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] PATH_INFO: `/v3/users/59c3ee8c88244f6a911ada7a31e24e29` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:45.271248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c3ee8c88244f6a911ada7a31e24e29)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:45.275520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:45.608351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05f3b8-7976-4c9f-8561-c7e9aa4b124b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:45.608956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05f3b8-7976-4c9f-8561-c7e9aa4b124b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:45.608956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05f3b8-7976-4c9f-8561-c7e9aa4b124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:45.652627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c3ee8c88244f6a911ada7a31e24e29'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.658702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c3ee8c88244f6a911ada7a31e24e29'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.681497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4e05f3b8-7976-4c9f-8561-c7e9aa4b124b None None] MFA Rules not processed for user `69684b11ca0c4af08d081da48b898115`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:45.686235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4e05f3b8-7976-4c9f-8561-c7e9aa4b124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:45.687577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c3ee8c88244f6a911ada7a31e24e29'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.703338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c3ee8c88244f6a911ada7a31e24e29'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.705063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-834275d8-bcfc-43e4-929e-2ef0365066c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c3ee8c88244f6a911ada7a31e24e29'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.799456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 851/1638] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:45.801503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:45.801945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:45.802377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:45.818851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 788/1639] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:45 2022] DELETE /identity/v3/users/59c3ee8c88244f6a911ada7a31e24e29 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:45.824627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:45.824991 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:45.825222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:45.832223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] MFA Rules not processed for user `69684b11ca0c4af08d081da48b898115`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:45.833503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:45.850999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:45.852357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:45.923238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:45.937420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 852/1640] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:45.960032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 789/1641] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:45.970151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:45.971723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:45.973802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:45.975492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:46.052788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:46.083924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743e40f-38c2-48e2-b353-dcc3c9aff2a0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.090672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdba191-7e57-4010-a16a-1b731f4c6a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.091379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdba191-7e57-4010-a16a-1b731f4c6a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.091668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdba191-7e57-4010-a16a-1b731f4c6a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.091983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdba191-7e57-4010-a16a-1b731f4c6a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.116055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdba191-7e57-4010-a16a-1b731f4c6a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.117584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdba191-7e57-4010-a16a-1b731f4c6a7b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.152650 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 790/1642] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:46.178244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904539ba-05f6-4b66-8610-5b4086d830a9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.205236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061bfa-c3dc-4a82-82d5-53bd6604f508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.205878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061bfa-c3dc-4a82-82d5-53bd6604f508 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.206166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061bfa-c3dc-4a82-82d5-53bd6604f508 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.206446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061bfa-c3dc-4a82-82d5-53bd6604f508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.234717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061bfa-c3dc-4a82-82d5-53bd6604f508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.240586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061bfa-c3dc-4a82-82d5-53bd6604f508 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.285987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 853/1643] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:47.316430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da007-6cfd-47fc-8c43-71937bc9530a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.317552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da007-6cfd-47fc-8c43-71937bc9530a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.317552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da007-6cfd-47fc-8c43-71937bc9530a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.318689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 791/1644] 10.222.0.76 () {54 vars in 912 bytes} [Wed Aug 31 19:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:31:47.333784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.334340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.334340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.437125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da007-6cfd-47fc-8c43-71937bc9530a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.443763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0f0da007-6cfd-47fc-8c43-71937bc9530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:47.453082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:47.454389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:47.469060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 854/1645] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:47.481506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da007-6cfd-47fc-8c43-71937bc9530a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.488581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.490066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.490789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.491440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] PATH_INFO: `/v3/users/8f59d75fa3944e85b93777259c664686` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.494265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f59d75fa3944e85b93777259c664686)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.497557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.595741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.611506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86d69-c3d3-460a-ad67-2f6c41a9267c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.623767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03810d2d-f4bd-4a83-8246-1bf68c001f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.628274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03810d2d-f4bd-4a83-8246-1bf68c001f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.628960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03810d2d-f4bd-4a83-8246-1bf68c001f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.629456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03810d2d-f4bd-4a83-8246-1bf68c001f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.652078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03810d2d-f4bd-4a83-8246-1bf68c001f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.653948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03810d2d-f4bd-4a83-8246-1bf68c001f55 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.676211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 855/1646] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:47.829176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f59d75fa3944e85b93777259c664686'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:47.830515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f59d75fa3944e85b93777259c664686'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:47.883629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f59d75fa3944e85b93777259c664686'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:47.900567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f59d75fa3944e85b93777259c664686'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:47.901561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f59d75fa3944e85b93777259c664686'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:48.052015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 792/1647] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:47 2022] DELETE /identity/v3/users/8f59d75fa3944e85b93777259c664686 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:48.057641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.058054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.058439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.125251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:48.127077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:48.209027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:48.257573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 856/1648] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:48.283880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:48.285416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:48.458724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaaaaf-776c-4a30-80b3-fd6233e624c1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:48.475408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:48.476239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.480294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.481344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.513858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:48.525905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:48.566444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 793/1649] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:48.718821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:48.720552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:48.741855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdd7f3-2717-4f92-b87b-ac0e080035e8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:48.750046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:48.751651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.752460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.753004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] PATH_INFO: `/v3/projects/2de8ee2ecd054928b81ee67ab36fbb3c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.755306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de8ee2ecd054928b81ee67ab36fbb3c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:48.758391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:49.010561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:49.012509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.042026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74ba8-642d-43b6-b69d-4bcbef9a4210 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:49.069213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:49.070375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.071422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.073466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] PATH_INFO: `/v3/users/54ea9c76fa6b40e8be5bca407a886d71` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.079028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ea9c76fa6b40e8be5bca407a886d71)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:49.083721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:49.090903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de8ee2ecd054928b81ee67ab36fbb3c', 'request_id': 'req-1c2e97df-b569-43f7-8044-9a95483e4ca5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.218296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de8ee2ecd054928b81ee67ab36fbb3c', 'request_id': 'req-1c2e97df-b569-43f7-8044-9a95483e4ca5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.228431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de8ee2ecd054928b81ee67ab36fbb3c', 'request_id': 'req-1c2e97df-b569-43f7-8044-9a95483e4ca5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.243689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] The token cache is being invalidate because project 2de8ee2ecd054928b81ee67ab36fbb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:49.244251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.245728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.249491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 857/1650] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:48 2022] DELETE /identity/v3/projects/2de8ee2ecd054928b81ee67ab36fbb3c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:49.250834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:49.253143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.374376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e97df-b569-43f7-8044-9a95483e4ca5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:49.382640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:49.384406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.384889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.385526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.388973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.409635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:49.411482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b7674-7496-49b2-8134-d675f2ea7712 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:49.417727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ea9c76fa6b40e8be5bca407a886d71'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.421265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ea9c76fa6b40e8be5bca407a886d71'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.437591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 858/1651] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:49.439473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e210ad5-ab51-4a01-9e36-ec99082894fb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.439889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e210ad5-ab51-4a01-9e36-ec99082894fb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.440321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e210ad5-ab51-4a01-9e36-ec99082894fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.470470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6e210ad5-ab51-4a01-9e36-ec99082894fb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:49.472567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ea9c76fa6b40e8be5bca407a886d71'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.482204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6e210ad5-ab51-4a01-9e36-ec99082894fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.500501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ea9c76fa6b40e8be5bca407a886d71'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.503770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-39375a1c-35d4-42fc-95b1-635c99a3de7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ea9c76fa6b40e8be5bca407a886d71'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.572318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 859/1652] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:49.572318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe939c2-e03d-48b9-86f9-d393c84c5ca3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.572318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe939c2-e03d-48b9-86f9-d393c84c5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.572318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe939c2-e03d-48b9-86f9-d393c84c5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.592657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7fe939c2-e03d-48b9-86f9-d393c84c5ca3 None None] MFA Rules not processed for user `69684b11ca0c4af08d081da48b898115`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:49.594554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7fe939c2-e03d-48b9-86f9-d393c84c5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.618677 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 794/1653] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:49 2022] DELETE /identity/v3/users/54ea9c76fa6b40e8be5bca407a886d71 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:49.620283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.620860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.621276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.625098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:49.692504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 860/1654] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:49.695639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.696482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.697147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.719297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:49.720557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.725721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:49.727302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.888483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 795/1655] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:49.894715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:49.927121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7082561-f11b-4b39-b995-329df426eef0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:49.933979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 861/1656] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:49.942386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:49.943348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.943854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.944271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.946829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:49.947892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:49.952122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:49.996836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 796/1657] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:50.003701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.010792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7751-25f2-4743-8b14-d6951c151eef None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.025070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.025797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.026152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.026510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.027249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.045679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:50.063724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.066407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:50.192953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 862/1658] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:49 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:31:50.194345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.234724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1458e7-57b1-49d4-b606-76504f611417 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.365004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d990a-c5f0-4623-8105-974e0267dec7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.373690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.374633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.375065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.375500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.382039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.383340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.383857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.384766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.389731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.396653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:50.400472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.402613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:50.425747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 797/1659] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:50.593942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 863/1660] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:50 2022] POST /identity/v3/users => generated 287 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:50.595845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.626037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:50.630387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a936e-a007-4b2f-aa96-757cb8dcde2b service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.646738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.651698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.652185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.652954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.654925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.668833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:50.720048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.720348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 798/1661] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:50.746120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f917228-d13e-411d-af8d-24725fa81b97 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.764798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15477cbc-e5f4-44c8-b892-6dc98a1c6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.766085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15477cbc-e5f4-44c8-b892-6dc98a1c6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.766599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15477cbc-e5f4-44c8-b892-6dc98a1c6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.767121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15477cbc-e5f4-44c8-b892-6dc98a1c6e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.768173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15477cbc-e5f4-44c8-b892-6dc98a1c6e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.770998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15477cbc-e5f4-44c8-b892-6dc98a1c6e73 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:50.806216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 864/1662] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:50.810316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.864033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cfaa3-b47b-40fd-8833-b235d05d8b57 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.883922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.887301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.887662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.888975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] PATH_INFO: `/v3/projects/9b93df282b7c478d9070d964685f8a0e/users/e21838764b19491a932f2553be27122e/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.930876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b93df282b7c478d9070d964685f8a0e, user_id=e21838764b19491a932f2553be27122e, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.938767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:51.236639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 799/1663] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:50 2022] PUT /identity/v3/projects/9b93df282b7c478d9070d964685f8a0e/users/e21838764b19491a932f2553be27122e/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:31:51.260558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e667a1-6357-44a7-bb31-2359770e753b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:51.260763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e667a1-6357-44a7-bb31-2359770e753b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:51.261054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e667a1-6357-44a7-bb31-2359770e753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:51.297193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c3e667a1-6357-44a7-bb31-2359770e753b None None] MFA Rules not processed for user `e21838764b19491a932f2553be27122e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:51.298817 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c3e667a1-6357-44a7-bb31-2359770e753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:51.491367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 865/1664] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:51.505558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:51.509228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:51.668408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d07f-c4d4-4a1a-825e-36b584dfc634 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:51.675971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03f62f-5588-4b17-ad3a-922ea1c7945d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:51.677135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03f62f-5588-4b17-ad3a-922ea1c7945d service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:51.677666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03f62f-5588-4b17-ad3a-922ea1c7945d service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:51.678143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03f62f-5588-4b17-ad3a-922ea1c7945d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:51.698749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03f62f-5588-4b17-ad3a-922ea1c7945d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:51.705865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03f62f-5588-4b17-ad3a-922ea1c7945d service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:51.734191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 800/1665] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:31:52.079434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efb095-69c3-4a8f-920a-d4047551f214 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.082348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efb095-69c3-4a8f-920a-d4047551f214 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.082348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efb095-69c3-4a8f-920a-d4047551f214 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.083580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 866/1666] 10.222.0.76 () {54 vars in 912 bytes} [Wed Aug 31 19:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:31:52.121426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.121735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.122303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.197188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:52.198299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:52.227779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efb095-69c3-4a8f-920a-d4047551f214 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.359056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efb095-69c3-4a8f-920a-d4047551f214 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.365682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.366554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.367176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.368305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] PATH_INFO: `/v3/users/e21838764b19491a932f2553be27122e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.371446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21838764b19491a932f2553be27122e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.372013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 801/1667] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:52.379155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:31:52.379155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: warnings.warn(msg) Aug 31 19:31:52.379155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: Aug 31 19:31:52.380472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.400527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.404622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:52.436488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54950aa0-f915-4374-8a07-318e6cf4cf4f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.452018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.458357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.459012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.459561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] PATH_INFO: `/v3/projects/3a9451c6c4fc4c2e93bb649707635778` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.462859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9451c6c4fc4c2e93bb649707635778)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.466039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:31:52.466039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 31 19:31:52.466039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: Aug 31 19:31:52.479433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.689085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21838764b19491a932f2553be27122e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.769110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9451c6c4fc4c2e93bb649707635778', 'request_id': 'req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.770862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21838764b19491a932f2553be27122e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.797498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21838764b19491a932f2553be27122e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.800031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21838764b19491a932f2553be27122e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.910254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9451c6c4fc4c2e93bb649707635778', 'request_id': 'req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.941901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9451c6c4fc4c2e93bb649707635778', 'request_id': 'req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.967632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] The token cache is being invalidate because project 3a9451c6c4fc4c2e93bb649707635778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:52.968262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.969242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:52.979799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 802/1668] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:52 2022] DELETE /identity/v3/projects/3a9451c6c4fc4c2e93bb649707635778 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:52.981643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.983441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:52.993431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21838764b19491a932f2553be27122e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:53.001118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 867/1669] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:52 2022] DELETE /identity/v3/users/e21838764b19491a932f2553be27122e => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:53.002535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:53.005176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.120440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:53.165617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83fd5-e6c6-46ef-bfff-76a84de5a1d3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:53.186586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba84d-ba06-4f97-8724-e43ae8184118 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:53.192059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:53.192722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:53.193045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:53.193318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] PATH_INFO: `/v3/users/010f2baf51484e7e8d715918d6b8794c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:53.194478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010f2baf51484e7e8d715918d6b8794c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:53.196729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:53.287022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:53.288133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:53.290339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:53.290607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:53.295351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.314472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:53.317287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f7a56-f0ef-4cd6-92b4-f2296f874d53 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:53.354857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 803/1670] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:53.357254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bc3e-72bc-41bc-b17e-4ca2d7c1f52a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:53.357659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bc3e-72bc-41bc-b17e-4ca2d7c1f52a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:53.358060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bc3e-72bc-41bc-b17e-4ca2d7c1f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:53.409882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e300bc3e-72bc-41bc-b17e-4ca2d7c1f52a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:53.411625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e300bc3e-72bc-41bc-b17e-4ca2d7c1f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.443869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 804/1671] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:53.452143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e673-16cd-41f8-8e09-73bee40da7d1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:53.452621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e673-16cd-41f8-8e09-73bee40da7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:53.453044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e673-16cd-41f8-8e09-73bee40da7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:53.526657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-43c6e673-16cd-41f8-8e09-73bee40da7d1 None None] MFA Rules not processed for user `c80a3e49a7cc420ab6709b0f2c54c079`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:53.527660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010f2baf51484e7e8d715918d6b8794c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:53.552996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010f2baf51484e7e8d715918d6b8794c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:53.554397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-43c6e673-16cd-41f8-8e09-73bee40da7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.567032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010f2baf51484e7e8d715918d6b8794c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:53.567639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010f2baf51484e7e8d715918d6b8794c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:53.669266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010f2baf51484e7e8d715918d6b8794c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:53.676627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 868/1672] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:53 2022] DELETE /identity/v3/users/010f2baf51484e7e8d715918d6b8794c => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:53.683267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:53.683267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.715505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 805/1673] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:53.717345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:53.717636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:53.717917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:53.744450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] MFA Rules not processed for user `c80a3e49a7cc420ab6709b0f2c54c079`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:53.746292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.821648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bed8f-236a-4364-8aa4-a648118eada3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:53.841170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:53.841814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:53.842095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:53.844549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:53.858178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.869859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 806/1674] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:53.884251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:53.888949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:53.909738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:54.062234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:54.063749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:54.094980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70473437-90cd-4705-b1e2-dccbd522b144 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:54.097709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 869/1675] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:54.100658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:54.103141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0587c-74de-4ec1-9514-74e7f3ee638c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:54.106924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0587c-74de-4ec1-9514-74e7f3ee638c service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:54.106924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0587c-74de-4ec1-9514-74e7f3ee638c service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:54.106924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0587c-74de-4ec1-9514-74e7f3ee638c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:54.109016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:54.125820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0587c-74de-4ec1-9514-74e7f3ee638c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:54.129287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0587c-74de-4ec1-9514-74e7f3ee638c service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:54.154181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7d93-9e08-4a89-956e-e7a10d397f29 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:54.160621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 807/1676] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:31:54.169169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:54.169829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:54.170121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:54.170395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] PATH_INFO: `/v3/projects/d7c9f4aaf944450396a9380a72cbbe56` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:54.175190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c9f4aaf944450396a9380a72cbbe56)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:54.179640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:54.467537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c9f4aaf944450396a9380a72cbbe56', 'request_id': 'req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:54.618446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c9f4aaf944450396a9380a72cbbe56', 'request_id': 'req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:54.627951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c9f4aaf944450396a9380a72cbbe56', 'request_id': 'req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:54.654100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] The token cache is being invalidate because project d7c9f4aaf944450396a9380a72cbbe56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:54.659710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:54.659710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e767f7b8-e946-464e-9aa0-ea91c3c87d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:54.666640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 870/1677] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:54 2022] DELETE /identity/v3/projects/d7c9f4aaf944450396a9380a72cbbe56 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:54.668512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:54.668821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:54.669105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:54.713435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:54.714878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:54.908415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 808/1678] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:54.916400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:54.925162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:54.925162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:55.003093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:55.004450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:55.023538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:55.035633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 871/1679] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:55.037272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:55.054165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9354-0709-42df-a37e-dc8a1b38fb26 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:55.073586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:55.074372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:55.074564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:55.074957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:55.075635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:55.076407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:55.079701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4772b1-41b8-4971-bd55-5b6e2daff74d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:55.113151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 809/1680] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:55.114601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:55.142059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d0a9a-0d90-4ebf-b310-80ae1f32793e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:55.162523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:55.163202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:55.168355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:55.169710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:55.170593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:55.176073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:55.257483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e915-8b0a-4fc6-ae27-f75af0ebc47d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:55.257840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e915-8b0a-4fc6-ae27-f75af0ebc47d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:55.259116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e915-8b0a-4fc6-ae27-f75af0ebc47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:55.336931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3e66e915-8b0a-4fc6-ae27-f75af0ebc47d None None] MFA Rules not processed for user `bec99c3414d44b85981e0122b0b4aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:55.337710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3e66e915-8b0a-4fc6-ae27-f75af0ebc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:55.444211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 872/1681] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:55 2022] POST /identity/v3/projects => generated 373 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:55.445460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:55.535009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 810/1682] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:55.609249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e23e07-eeb9-4485-add7-951ce19a2c41 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:55.623896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:55.624423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:55.624708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:55.625019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:55.625669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:55.630927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:55.822806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:55.823478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:55.823966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:55.886956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 873/1683] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:55 2022] POST /identity/v3/users => generated 287 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:55.888017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:55.894446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:55.913980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:55.921110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:56.043342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 811/1684] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:56.045840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:56.061242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363c41-570c-4c1c-86d1-61e154494cf2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:56.072720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca61b-4c66-4bad-97b9-563e27ad91ba None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:56.074603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270971d-0c10-4498-9d6a-d30a8709cf93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:56.076082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270971d-0c10-4498-9d6a-d30a8709cf93 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.076082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270971d-0c10-4498-9d6a-d30a8709cf93 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.076082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270971d-0c10-4498-9d6a-d30a8709cf93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.085298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:56.086073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.087098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.087401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.088078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:56.097594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:56.121485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 812/1685] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:56.134884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:56.167647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e245-8691-4711-8f21-f2bb851092ae admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:56.190250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:56.190999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.191319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.191649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.192449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:56.194456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:56.224522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270971d-0c10-4498-9d6a-d30a8709cf93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:56.227934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270971d-0c10-4498-9d6a-d30a8709cf93 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:56.243316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 813/1686] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:31:56.245671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:56.273224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 874/1687] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:56.280118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537733-e423-4dd2-b7f6-3daefeae1c23 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:56.303239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:56.303940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.304230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.304512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] PATH_INFO: `/v3/projects/3f5b12831dd44d9fbb2f678602b95413/users/df7bcf488d3c46ae8c18279d7ee4ecf2/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.361711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5b12831dd44d9fbb2f678602b95413, user_id=df7bcf488d3c46ae8c18279d7ee4ecf2, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:56.371309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:56.520061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 814/1688] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:56 2022] PUT /identity/v3/projects/3f5b12831dd44d9fbb2f678602b95413/users/df7bcf488d3c46ae8c18279d7ee4ecf2/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:56.528740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.529065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.529675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.612601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:56.625312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:56.641171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] MFA Rules not processed for user `df7bcf488d3c46ae8c18279d7ee4ecf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:56.644550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:56.794758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346f86d-01ee-440a-941b-4b7bc367ad98 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:56.799339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:56.812645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:56.812645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.812645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.812645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] PATH_INFO: `/v3/projects/5f613e371c5e46518c752536f6c7e692` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.812974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 875/1689] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:56.813265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f613e371c5e46518c752536f6c7e692)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:56.815624 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:56.816858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:56.855698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683994-e053-4b91-94fa-d836abc67cf8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:56.874891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:56.879264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:56.879264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:56.879264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:56.879264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:56.884184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:57.073863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f613e371c5e46518c752536f6c7e692', 'request_id': 'req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:57.118424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 876/1690] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:56 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:57.121187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:57.140118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:57.168240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f613e371c5e46518c752536f6c7e692', 'request_id': 'req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:57.177725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f613e371c5e46518c752536f6c7e692', 'request_id': 'req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:57.225927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] The token cache is being invalidate because project 5f613e371c5e46518c752536f6c7e692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:57.226242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:57.227464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:57.230523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 815/1691] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:56 2022] DELETE /identity/v3/projects/5f613e371c5e46518c752536f6c7e692 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:57.232124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:57.243414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:57.328205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759829fa-33fe-4308-bd1b-41ebaae781c1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:57.337004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:57.338372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:57.338800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:57.339224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:57.342210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:57.418524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f075-eeaf-4f6b-aa4f-3e9ead8d2461 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:57.454293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:57.461240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:57.472385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 877/1692] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:31:57.477629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:57.482324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:57.587897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:57.589662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:57.590198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:57.592424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] PATH_INFO: `/v3/projects/9b93df282b7c478d9070d964685f8a0e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:57.605430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b93df282b7c478d9070d964685f8a0e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:57.605430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:57.676499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84e38-aaa5-4bdf-85ac-2a022bac054c service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:57.683653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732130e-86fe-46ec-bac0-eb37c7beecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:57.685060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732130e-86fe-46ec-bac0-eb37c7beecf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:57.685673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732130e-86fe-46ec-bac0-eb37c7beecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:57.686244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732130e-86fe-46ec-bac0-eb37c7beecf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:57.687086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732130e-86fe-46ec-bac0-eb37c7beecf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:57.689536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732130e-86fe-46ec-bac0-eb37c7beecf4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:57.850492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b93df282b7c478d9070d964685f8a0e', 'request_id': 'req-ccb20b6d-798b-403b-a5a7-1a0700a45b90'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:57.977637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 878/1693] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:57 2022] POST /identity/v3/users => generated 293 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:57.980405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:57.983856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:57.997510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:58.074955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b93df282b7c478d9070d964685f8a0e', 'request_id': 'req-ccb20b6d-798b-403b-a5a7-1a0700a45b90'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:58.083905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b93df282b7c478d9070d964685f8a0e', 'request_id': 'req-ccb20b6d-798b-403b-a5a7-1a0700a45b90'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:58.126771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] The token cache is being invalidate because project 9b93df282b7c478d9070d964685f8a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:58.127324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:58.131768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ccb20b6d-798b-403b-a5a7-1a0700a45b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:58.141328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:58.142607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:58.143558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 816/1694] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:57 2022] DELETE /identity/v3/projects/9b93df282b7c478d9070d964685f8a0e => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:58.151428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34437f-eb09-4fa5-a91b-724b786ffeaf None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:58.154504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34437f-eb09-4fa5-a91b-724b786ffeaf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:58.154911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34437f-eb09-4fa5-a91b-724b786ffeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:58.313400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 879/1695] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:58.314750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:58.316474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:58.320438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5e34437f-eb09-4fa5-a91b-724b786ffeaf None None] MFA Rules not processed for user `5d72d15d3d7848baaba2968bb4a16ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:58.322097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5e34437f-eb09-4fa5-a91b-724b786ffeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:58.380635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:58.409960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58243449-6b32-4a9f-9074-b7f90babe645 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:58.440839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582374-7779-437b-92c6-31f65c9a176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:58.446475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582374-7779-437b-92c6-31f65c9a176d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:58.447878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582374-7779-437b-92c6-31f65c9a176d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:58.448625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582374-7779-437b-92c6-31f65c9a176d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:58.453386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86582374-7779-437b-92c6-31f65c9a176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:58.466206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86582374-7779-437b-92c6-31f65c9a176d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:58.536631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 880/1696] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:58.557399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:58.557822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:58.558124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:58.628077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:58.642073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 817/1697] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:58.643623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:58.650377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:58.657289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:58.663392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:58.707804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 881/1698] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:58.708966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:58.748499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84f3a-be10-4d51-8051-29a14f05b89b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:58.758445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:58.764005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:58.774766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584536d-e4fa-403e-a152-75f0949e8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:58.775473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584536d-e4fa-403e-a152-75f0949e8ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:58.775762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584536d-e4fa-403e-a152-75f0949e8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:58.776089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584536d-e4fa-403e-a152-75f0949e8ff7 admin admin] PATH_INFO: `/v3/projects/22d62c988eba478ca87e7a9149d3493d/users/da93fa6b87fa42a394177d989c680bde/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:58.907252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584536d-e4fa-403e-a152-75f0949e8ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d62c988eba478ca87e7a9149d3493d, user_id=da93fa6b87fa42a394177d989c680bde, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:58.907252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584536d-e4fa-403e-a152-75f0949e8ff7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:58.907671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 818/1699] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:58.907671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:58.907671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:59.110440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 882/1700] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:58 2022] PUT /identity/v3/projects/22d62c988eba478ca87e7a9149d3493d/users/da93fa6b87fa42a394177d989c680bde/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:59.110851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.111174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.113047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.252758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.259115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:59.260544 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:59.262842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c9c92-f18f-4135-aa61-48cd6734e96b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:59.596399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 883/1701] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:59.600997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:59.647530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:59.649707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.655078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.655616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.657504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5126ad0-bda7-488d-b885-a629c74611c6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:59.675808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:59.676737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.677217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.677642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.678550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:59.679017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:59.681551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:59.730411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 884/1702] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:59.732835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:59.757385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ab81-d41a-420c-a029-899948beb78c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:59.776094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cf387-9bc2-4d99-adfb-e4c4610c909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:59.776094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cf387-9bc2-4d99-adfb-e4c4610c909c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.776094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cf387-9bc2-4d99-adfb-e4c4610c909c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.776094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cf387-9bc2-4d99-adfb-e4c4610c909c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.776725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cf387-9bc2-4d99-adfb-e4c4610c909c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:59.778584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cf387-9bc2-4d99-adfb-e4c4610c909c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:59.803725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 885/1703] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:59.816243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.816243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.816243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.836477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:59.838635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:59.851352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:59.856400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:59.864886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 819/1704] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 978 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:59.869468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:59.885847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fecb5-8524-487b-b622-fe6b241116a9 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:59.893020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:59.894146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.894583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.895031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.895940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:59.896408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:59.898515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:59.917302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 820/1705] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:59.918404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:59.933631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e1096-7238-43bb-ab19-31d828cc0b1a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:59.949564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:59.950825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.951291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.951723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.952667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:59.954896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:00.063959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 886/1706] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 31 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:00.066689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:00.094378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 821/1707] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:59 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:00.099941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:00.111733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8673-f585-427e-94ab-160918cbff68 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:00.347093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3803-568f-40be-8942-f4cd6a7a5ed8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:00.365087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:00.365087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:00.365087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:00.365087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:00.365398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:00.365398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:00.372393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:00.376759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:00.389461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:00.390060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] PATH_INFO: `/v3/projects/22d62c988eba478ca87e7a9149d3493d/users/da93fa6b87fa42a394177d989c680bde/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:00.402407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d62c988eba478ca87e7a9149d3493d, user_id=da93fa6b87fa42a394177d989c680bde, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:00.406433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:00.449572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 887/1708] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:00 2022] PUT /identity/v3/projects/22d62c988eba478ca87e7a9149d3493d/users/da93fa6b87fa42a394177d989c680bde/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:00.452018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:00.583214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 822/1709] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:00 2022] POST /identity/v3/projects => generated 357 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:00.588525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:00.600144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:00.618486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0641-9337-4aa7-aac0-f0aa636fb607 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:00.838763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfc83b-ebe9-4f46-93a0-54c456add1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:00.839996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfc83b-ebe9-4f46-93a0-54c456add1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:00.840448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfc83b-ebe9-4f46-93a0-54c456add1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:00.841244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfc83b-ebe9-4f46-93a0-54c456add1bf admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:00.843168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfc83b-ebe9-4f46-93a0-54c456add1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:00.851155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfc83b-ebe9-4f46-93a0-54c456add1bf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:00.914454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580cab-b8e2-4dad-8b55-581e9d77237a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:00.931462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed113a8-b557-487e-9fb8-6d8eaa7f3693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:00.932586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed113a8-b557-487e-9fb8-6d8eaa7f3693 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:00.933072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed113a8-b557-487e-9fb8-6d8eaa7f3693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:00.933516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed113a8-b557-487e-9fb8-6d8eaa7f3693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:00.949598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed113a8-b557-487e-9fb8-6d8eaa7f3693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:00.956230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed113a8-b557-487e-9fb8-6d8eaa7f3693 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:00.987361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 823/1710] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:00.996966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:00.997642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:00.997923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:01.077679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 888/1711] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:00 2022] POST /identity/v3/users => generated 284 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:01.079431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:01.079726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:01.080000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:01.127671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] MFA Rules not processed for user `76a42ecd5a0b4058ab1192e8a019e087`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:01.127671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:01.170067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] MFA Rules not processed for user `da93fa6b87fa42a394177d989c680bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:01.173424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:01.340739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 824/1712] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:01.341758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:01.379076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 889/1713] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:01.385925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80af884-3c3e-4356-9739-fcc441413591 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:01.391110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:01.406504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:01.407159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:01.407444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:01.407727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:01.409000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:01.411489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:01.428159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daca70b-8555-4c26-a770-d8821bbf4cb2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:01.452244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:01.452925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:01.453222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:01.453509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:01.454189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:01.467965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:01.496667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 890/1714] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:01.498906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:01.506598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:01.740604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486eff6-da47-44e0-81e1-ae0ec92f6335 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:01.763602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 825/1715] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:01 2022] POST /identity/v3/users => generated 279 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:01.764915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:01.774551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:01.779827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:01.781576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:01.783566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:01.785568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:01.833377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:01.839014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:01.896236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 891/1716] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:01.922199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:02.006320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb79a-5da8-4524-bb7d-b3160e712f97 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:02.048625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:02.049329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.049611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.053145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.056263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:02.061351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:02.120998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 892/1717] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:02.120998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:02.128646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b80302-f544-4335-b7c8-8c7c7a63bc79 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:02.154952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:02.154952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.155405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.155564 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.164265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefbef5-1c09-4a72-9a80-2b09ec561d5e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:02.175062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:02.175775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:02.176579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.177361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:02.177844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.179087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.179992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:02.185713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:02.190652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 826/1718] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:02.191526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:02.233882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b4b5f-90ef-4055-a1de-f2430c455fe5 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:02.253247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 893/1719] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:02.256796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e4183-acf3-4c8a-b1d4-ef179979008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:02.257612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4183-acf3-4c8a-b1d4-ef179979008a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.257795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4183-acf3-4c8a-b1d4-ef179979008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.259032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:02.262447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4183-acf3-4c8a-b1d4-ef179979008a admin admin] PATH_INFO: `/v3/projects/6454076dbecb44b0bfc1a5fd1bb6e879/users/fb844c3861934ba1b7aff57eeeefe6ee/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.303943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e855615-c6bd-4b81-9c17-eeadbf95fe45 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:02.314534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e4183-acf3-4c8a-b1d4-ef179979008a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6454076dbecb44b0bfc1a5fd1bb6e879, user_id=fb844c3861934ba1b7aff57eeeefe6ee, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:02.328307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e4183-acf3-4c8a-b1d4-ef179979008a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:02.328412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:02.328412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.328412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.328412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.329399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:02.335430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:02.372309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 894/1720] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:02.376629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:02.394971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552b46-7f1b-4d27-bb40-118e7ffffc62 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:02.412034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa5b1-6aa5-4e5e-8f19-6b1109e426a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:02.412649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa5b1-6aa5-4e5e-8f19-6b1109e426a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.412990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa5b1-6aa5-4e5e-8f19-6b1109e426a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.413315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa5b1-6aa5-4e5e-8f19-6b1109e426a8 admin admin] PATH_INFO: `/v3/projects/ae43d6e7c4ec496b9ad88e405e317a71/users/9b6c623174924e8fa029fd080debebcd/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.454040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa5b1-6aa5-4e5e-8f19-6b1109e426a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae43d6e7c4ec496b9ad88e405e317a71, user_id=9b6c623174924e8fa029fd080debebcd, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:02.457272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa5b1-6aa5-4e5e-8f19-6b1109e426a8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:02.464441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.622290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 827/1721] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:02 2022] PUT /identity/v3/projects/6454076dbecb44b0bfc1a5fd1bb6e879/users/fb844c3861934ba1b7aff57eeeefe6ee/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:02.632574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.633540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.633929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.647794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 895/1722] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:02 2022] PUT /identity/v3/projects/ae43d6e7c4ec496b9ad88e405e317a71/users/9b6c623174924e8fa029fd080debebcd/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:02.663452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:02.664009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:02.664655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:02.753754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] MFA Rules not processed for user `fb844c3861934ba1b7aff57eeeefe6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:02.755181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:02.757358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] MFA Rules not processed for user `9b6c623174924e8fa029fd080debebcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:02.760281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:02.942047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 828/1723] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:02.943133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:02.984608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 896/1724] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:03.003224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:03.145555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044475-651b-4bbc-a545-26e7046a5d59 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:03.160164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:03.160830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.161126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.161404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.162080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:03.170201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:03.187751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936f586-51c8-4ed4-9c7d-89b0c20345e2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:03.200067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:03.200714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.201041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.201354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.201976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:03.204025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:03.602758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 829/1725] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:02 2022] POST /identity/v3/projects => generated 367 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:03.603043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 897/1726] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:02 2022] POST /identity/v3/projects => generated 357 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:03.604637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:03.605157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:03.809820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a91882-b876-43c0-9857-0a5fd5d54ce3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:03.823361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:03.824789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.824789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.824789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.838949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd0378-f6cd-40a4-837c-fb7ed8ee3116 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:03.840406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:03.847576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:03.858570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:03.868643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.870944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.871294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.872088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:03.875745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:04.190812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 898/1727] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:03 2022] POST /identity/v3/users => generated 290 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:04.194855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:04.260380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.270164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 830/1728] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:03 2022] POST /identity/v3/users => generated 285 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:04.275274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:04.292466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16db0-6072-42b0-b5da-e33543a0ef13 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:04.292575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3315e-4860-476c-979b-2009591c6014 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:04.303879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:04.304761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:04.305139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:04.305422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:04.306180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:04.308424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:04.323831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:04.339256 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:04.341114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:04.341541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:04.345002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:04.347059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:04.361069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 899/1729] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:04.362503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:04.386036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 831/1730] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:04.388765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:04.417181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837b78-d9fe-4686-b84d-ce8d9b00cbf7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:04.419012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc5fb-9402-4f5f-b5e7-bca4b9fed8b3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:04.441970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:04.447562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:04.449706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:04.449706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:04.449706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] PATH_INFO: `/v3/projects/11133afbfbb64c7cb3bf2a44a7be3d70/users/05b3a707d8754c07adb56b8675c1b84d/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:04.459548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:04.461760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:04.465585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] PATH_INFO: `/v3/projects/da41768ea58243b0b02728fb7667eaf5/users/4730b13837234c49aab3f00149b70351/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:04.505948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11133afbfbb64c7cb3bf2a44a7be3d70, user_id=05b3a707d8754c07adb56b8675c1b84d, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:04.508761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:04.537726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da41768ea58243b0b02728fb7667eaf5, user_id=4730b13837234c49aab3f00149b70351, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:04.553191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:04.845949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 900/1731] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:04 2022] PUT /identity/v3/projects/11133afbfbb64c7cb3bf2a44a7be3d70/users/05b3a707d8754c07adb56b8675c1b84d/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:04.848480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:04.927105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 832/1732] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:04 2022] PUT /identity/v3/projects/da41768ea58243b0b02728fb7667eaf5/users/4730b13837234c49aab3f00149b70351/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:04.932050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:05.007423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a7cc-378a-43d0-b190-55b6131055b3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:05.095685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:05.110261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.110261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.110261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.110261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:05.110261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:05.112985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 901/1733] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:05.116725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:05.133422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d120af-17c3-46d3-9f22-c13376ca9485 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:05.149818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c4888-7319-4b0e-8bdd-511090e755aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:05.152144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4888-7319-4b0e-8bdd-511090e755aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.152441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4888-7319-4b0e-8bdd-511090e755aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.153291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4888-7319-4b0e-8bdd-511090e755aa admin admin] PATH_INFO: `/v3/projects/11133afbfbb64c7cb3bf2a44a7be3d70/users/05b3a707d8754c07adb56b8675c1b84d/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.158509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c4888-7319-4b0e-8bdd-511090e755aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=11133afbfbb64c7cb3bf2a44a7be3d70, user_id=05b3a707d8754c07adb56b8675c1b84d, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:05.168774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7770cf-0c3f-4e3b-b63c-2f0ee3e30fa9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:05.172543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c4888-7319-4b0e-8bdd-511090e755aa admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:05.198173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:05.200994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.201450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.203252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.205731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:05.207694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:05.211896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 902/1734] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:05 2022] PUT /identity/v3/projects/11133afbfbb64c7cb3bf2a44a7be3d70/users/05b3a707d8754c07adb56b8675c1b84d/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:05.222813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.222813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.223274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.286170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 833/1735] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:05.286170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:05.310148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208cbb4-c47e-4cf1-bfac-d9c5471b62ea admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:05.344615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] MFA Rules not processed for user `05b3a707d8754c07adb56b8675c1b84d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:05.351143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:05.464305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bea37-779d-42f9-a0bc-9fe2bed38ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:05.465085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bea37-779d-42f9-a0bc-9fe2bed38ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.465262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bea37-779d-42f9-a0bc-9fe2bed38ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.468209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bea37-779d-42f9-a0bc-9fe2bed38ff2 admin admin] PATH_INFO: `/v3/projects/da41768ea58243b0b02728fb7667eaf5/users/4730b13837234c49aab3f00149b70351/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.477347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bea37-779d-42f9-a0bc-9fe2bed38ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da41768ea58243b0b02728fb7667eaf5, user_id=4730b13837234c49aab3f00149b70351, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:05.486056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bea37-779d-42f9-a0bc-9fe2bed38ff2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:05.528342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 834/1736] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:05 2022] PUT /identity/v3/projects/da41768ea58243b0b02728fb7667eaf5/users/4730b13837234c49aab3f00149b70351/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:05.538733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.539277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.540110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.575489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 903/1737] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:05.581615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:05.638228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] MFA Rules not processed for user `4730b13837234c49aab3f00149b70351`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:05.643207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:05.757138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7638-6bb9-4f21-b21c-2bc119e69cf2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:05.900638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:05.902933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:05.903993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:05.905089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:05.905524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 835/1738] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:05.906636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:06.065971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc30bc-aa48-488d-aee0-e26c0defc603 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:06.074626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:06.077649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:06.087540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:06.088279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:06.088523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:06.088792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] PATH_INFO: `/v3/users/df7bcf488d3c46ae8c18279d7ee4ecf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:06.091948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7bcf488d3c46ae8c18279d7ee4ecf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:06.093977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:06.095986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 904/1739] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:06.097308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:06.101398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:06.197498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4eea0-8a7a-476f-a0a4-130f42de75d7 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:06.197498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56574-f8a2-4226-b8c9-d2cdb93157e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:06.197498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56574-f8a2-4226-b8c9-d2cdb93157e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:06.197498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56574-f8a2-4226-b8c9-d2cdb93157e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:06.198121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56574-f8a2-4226-b8c9-d2cdb93157e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:06.198121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56574-f8a2-4226-b8c9-d2cdb93157e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:06.198121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56574-f8a2-4226-b8c9-d2cdb93157e3 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:06.234993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 905/1740] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:06.524663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb2ea4-3cd7-49a1-ad16-62b5b9b37e36 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:06.526454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb2ea4-3cd7-49a1-ad16-62b5b9b37e36 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:06.526454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb2ea4-3cd7-49a1-ad16-62b5b9b37e36 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:06.528589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 906/1741] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:06.594066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb2ea4-3cd7-49a1-ad16-62b5b9b37e36 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:06.614028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb2ea4-3cd7-49a1-ad16-62b5b9b37e36 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:06.626692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dbfee-d929-4971-b2b8-ec7c7ccc0423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:06.627806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dbfee-d929-4971-b2b8-ec7c7ccc0423 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:06.627806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dbfee-d929-4971-b2b8-ec7c7ccc0423 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:06.634079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dbfee-d929-4971-b2b8-ec7c7ccc0423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:06.778074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dbfee-d929-4971-b2b8-ec7c7ccc0423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:06.779824 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dbfee-d929-4971-b2b8-ec7c7ccc0423 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:06.791500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 907/1742] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:06.794424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:06.794424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:06.794424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:06.834703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:06.834703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:07.051224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.052337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 908/1743] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:07.101392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:07.101392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06505be-e6ca-4baf-84ad-6c87b63bdf1c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:07.101392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:07.101392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:07.102449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:07.102449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:07.105915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:07.108850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:07.132776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 909/1744] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:07.224937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:07.282087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6f1b5-4844-4f8d-8071-31deafb71c32 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:07.282740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7bcf488d3c46ae8c18279d7ee4ecf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:07.287103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7bcf488d3c46ae8c18279d7ee4ecf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:07.297787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdae814-3e3e-4387-ad59-b14b61a7cf88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:07.300619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdae814-3e3e-4387-ad59-b14b61a7cf88 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:07.301408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdae814-3e3e-4387-ad59-b14b61a7cf88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:07.301856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdae814-3e3e-4387-ad59-b14b61a7cf88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:07.386258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7bcf488d3c46ae8c18279d7ee4ecf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:07.413116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7bcf488d3c46ae8c18279d7ee4ecf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:07.420410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7bcf488d3c46ae8c18279d7ee4ecf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:07.427113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdae814-3e3e-4387-ad59-b14b61a7cf88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:07.430268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdae814-3e3e-4387-ad59-b14b61a7cf88 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:07.447050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 910/1745] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:07.559442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d40cb-ae50-4013-b24f-34df0c2d6402 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:07.559930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d40cb-ae50-4013-b24f-34df0c2d6402 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:07.560404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d40cb-ae50-4013-b24f-34df0c2d6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:07.629882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-884d40cb-ae50-4013-b24f-34df0c2d6402 None None] MFA Rules not processed for user `bec99c3414d44b85981e0122b0b4aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:07.631357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-884d40cb-ae50-4013-b24f-34df0c2d6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:07.782587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 911/1746] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:07.826462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 836/1747] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:05 2022] DELETE /identity/v3/users/df7bcf488d3c46ae8c18279d7ee4ecf2 => generated 0 bytes in 1920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:07.831387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:07.831676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:07.831955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:07.902253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:07.904983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:08.089802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 912/1748] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:08.344492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:08.346091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:08.607364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ed861-5ff4-4824-b85e-d70703f9ce86 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:08.615263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:08.616704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:08.617880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:08.618448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:08.661972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:08.663698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:08.726945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 837/1749] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:11.272956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:11.278444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:11.311362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb16c6-992d-4e98-932a-75188eb8f3f5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:11.340701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:11.341667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:11.342145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:11.342666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] PATH_INFO: `/v3/projects/3f5b12831dd44d9fbb2f678602b95413` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:11.344281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5b12831dd44d9fbb2f678602b95413)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:11.346437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:11.579774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5b12831dd44d9fbb2f678602b95413', 'request_id': 'req-141f6f9f-5d16-44da-8c4f-988df589d377'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:12.076651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5b12831dd44d9fbb2f678602b95413', 'request_id': 'req-141f6f9f-5d16-44da-8c4f-988df589d377'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:12.098052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5b12831dd44d9fbb2f678602b95413', 'request_id': 'req-141f6f9f-5d16-44da-8c4f-988df589d377'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:12.133402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] The token cache is being invalidate because project 3f5b12831dd44d9fbb2f678602b95413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:12.133811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:12.135038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141f6f9f-5d16-44da-8c4f-988df589d377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:12.142465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 913/1750] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:11 2022] DELETE /identity/v3/projects/3f5b12831dd44d9fbb2f678602b95413 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:12.144523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:12.167561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ed6b-32b1-4e6e-8295-0272fb70205f service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:12.429950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe9886-bb46-4dfc-946d-17f80730f4d0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:12.432647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe9886-bb46-4dfc-946d-17f80730f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:12.433455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe9886-bb46-4dfc-946d-17f80730f4d0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:12.437420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 914/1751] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:32:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:32:12.441430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:12.460654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:12.488073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:12.493634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:12.494076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:12.494554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:12.503387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] PATH_INFO: `/v3/users/da93fa6b87fa42a394177d989c680bde` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:12.506782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da93fa6b87fa42a394177d989c680bde)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:12.510160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:12.595185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:12.601493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:13.128985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 915/1752] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 634 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:13.176238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:13.178730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:13.227169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb682391-24e4-4179-bd26-03c8128bfd1e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:13.251576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504662d7-1f90-44c2-bc8d-ee12d3a350a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:13.252532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504662d7-1f90-44c2-bc8d-ee12d3a350a6 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:13.253061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504662d7-1f90-44c2-bc8d-ee12d3a350a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:13.253507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504662d7-1f90-44c2-bc8d-ee12d3a350a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:13.306511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504662d7-1f90-44c2-bc8d-ee12d3a350a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:13.306511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504662d7-1f90-44c2-bc8d-ee12d3a350a6 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:13.330552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da93fa6b87fa42a394177d989c680bde'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:13.333174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da93fa6b87fa42a394177d989c680bde'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:13.372627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da93fa6b87fa42a394177d989c680bde'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:13.379145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 916/1753] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:13.391070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da93fa6b87fa42a394177d989c680bde'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:13.394780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da93fa6b87fa42a394177d989c680bde'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:13.702779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 838/1754] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:12 2022] DELETE /identity/v3/users/da93fa6b87fa42a394177d989c680bde => generated 0 bytes in 1556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:14.551698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:14.723810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05511f-e09d-4c1b-b7e3-2b2c42403d83 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:14.724951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05511f-e09d-4c1b-b7e3-2b2c42403d83 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:14.725810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05511f-e09d-4c1b-b7e3-2b2c42403d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:14.798575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7c05511f-e09d-4c1b-b7e3-2b2c42403d83 None None] MFA Rules not processed for user `5d72d15d3d7848baaba2968bb4a16ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:14.801046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7c05511f-e09d-4c1b-b7e3-2b2c42403d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:15.009205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 917/1755] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:15.974074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:15.975571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:16.074210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c3824-837a-40d5-8b34-ecc4076ad230 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:16.078791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:16.079447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.079734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.080013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] PATH_INFO: `/v3/projects/22d62c988eba478ca87e7a9149d3493d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.081192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d62c988eba478ca87e7a9149d3493d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:16.083292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:16.313713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d62c988eba478ca87e7a9149d3493d', 'request_id': 'req-84c17a04-8ac5-4113-bcfe-70969a7472e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:16.372404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:16.373088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.374533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.375061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.410650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] MFA Rules not processed for user `76a42ecd5a0b4058ab1192e8a019e087`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:16.413000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:16.473992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d62c988eba478ca87e7a9149d3493d', 'request_id': 'req-84c17a04-8ac5-4113-bcfe-70969a7472e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:16.481154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d62c988eba478ca87e7a9149d3493d', 'request_id': 'req-84c17a04-8ac5-4113-bcfe-70969a7472e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:16.493194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] The token cache is being invalidate because project 22d62c988eba478ca87e7a9149d3493d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:16.493578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:16.494309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-84c17a04-8ac5-4113-bcfe-70969a7472e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:16.495879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 839/1756] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:15 2022] DELETE /identity/v3/projects/22d62c988eba478ca87e7a9149d3493d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:16.502473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e777c2-2009-4e2f-9ed5-7ec9c0f2d43b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.502985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e777c2-2009-4e2f-9ed5-7ec9c0f2d43b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.503476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e777c2-2009-4e2f-9ed5-7ec9c0f2d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.512975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 918/1757] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:16.536404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c0e777c2-2009-4e2f-9ed5-7ec9c0f2d43b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:16.536404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c0e777c2-2009-4e2f-9ed5-7ec9c0f2d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:16.562156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:16.564260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:16.602301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 840/1758] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:16.610122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.610714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.611005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.632388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:16.634630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:16.642905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 841/1759] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:16.647299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:16.651785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d0dda-dc24-4490-945e-0bd35e417b3a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:16.658233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5f32-3c2b-4d85-b838-85026a12e7c6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:16.661266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:16.661924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.662213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.662517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] PATH_INFO: `/v3/users/fb844c3861934ba1b7aff57eeeefe6ee` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.663333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:16.663681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb844c3861934ba1b7aff57eeeefe6ee)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:16.664275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.664578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.664962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.665696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:16.665862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:16.666350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:16.668421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:16.684851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 842/1760] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:32:16.689801 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:16.701532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ea6d-d615-4964-9bcd-bf6f74ffec5c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:16.708748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:16.708748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:16.708748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:16.708748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:16.709158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:16.710244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:16.932885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 843/1761] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:16 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:16.937367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:17.006024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b167f-5269-462c-8381-bcb7115f8aed admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:17.014919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb844c3861934ba1b7aff57eeeefe6ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:17.025006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb844c3861934ba1b7aff57eeeefe6ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:17.026543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:17.027298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.027712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.028236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.029241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:17.031655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:17.038423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb844c3861934ba1b7aff57eeeefe6ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:17.039712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb844c3861934ba1b7aff57eeeefe6ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:17.259384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ee40ee5a-2cdf-4ed5-9948-d5b32ee513a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb844c3861934ba1b7aff57eeeefe6ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:17.273733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 919/1762] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:16 2022] DELETE /identity/v3/users/fb844c3861934ba1b7aff57eeeefe6ee => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:17.276422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.276784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.277294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.278237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 844/1763] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:16 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:17.280188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:17.298145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:17.300980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:17.302330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:17.323519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a756-15cd-4498-b3f0-daba71b232a3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:17.421458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 920/1764] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:17.432551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:17.433208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.433491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.433766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.434462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:17.434858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:17.436085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:17.437126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:17.447444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 845/1765] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:17.451514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:17.474259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93c69-2fef-49f8-bef2-415e7e2f49f7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:17.485668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:17.486364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.486704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.487029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.487883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:17.490131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:17.539865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 846/1766] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:17.557859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:17.595418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bd56d-d3e4-477b-85b7-c28438d8ebb9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:17.596053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460f8c1-6cb5-47e7-ac11-7aed31823839 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:17.600605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40c0d5-5a7e-461b-863e-a7293da951ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:17.601448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c0d5-5a7e-461b-863e-a7293da951ab service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.601860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c0d5-5a7e-461b-863e-a7293da951ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.602261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c0d5-5a7e-461b-863e-a7293da951ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.608317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:17.609159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.609639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.610068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] PATH_INFO: `/v3/projects/688d667198064413b490626201b41047/users/ae95e87956864dd19297b9e4c0a31193/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.617292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40c0d5-5a7e-461b-863e-a7293da951ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:17.618798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40c0d5-5a7e-461b-863e-a7293da951ab service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:17.636484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 921/1767] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:17.639015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688d667198064413b490626201b41047, user_id=ae95e87956864dd19297b9e4c0a31193, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:17.642259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:17.831135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 847/1768] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:17 2022] PUT /identity/v3/projects/688d667198064413b490626201b41047/users/ae95e87956864dd19297b9e4c0a31193/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:17.845293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:17.849440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:17.849440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:17.875633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] MFA Rules not processed for user `ae95e87956864dd19297b9e4c0a31193`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:17.877285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:17.979525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 922/1769] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:17.985347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.078110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51e8a6-a928-478c-8779-19eb5ec5d176 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:18.083211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:18.083838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:18.084184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:18.084463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:18.085160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:18.087726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:18.334378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.336447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:18.340290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 848/1770] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:17 2022] POST /identity/v3/projects => generated 367 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:18.346052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.367716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e55b30-fd80-4e47-8931-a1719711d208 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:18.467300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4dc61-6b7d-4150-b982-ea94b3a8fdc6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:18.479076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:18.479951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:18.480351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:18.480622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:18.481369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:18.483314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:18.492769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:18.497045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:18.498480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:18.498480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] PATH_INFO: `/v3/projects/6454076dbecb44b0bfc1a5fd1bb6e879` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:18.500067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6454076dbecb44b0bfc1a5fd1bb6e879)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:18.502724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:18.635366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 849/1771] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:18 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:18.636832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.668213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1271f4-ce7a-4494-a9ce-31ce2dbcb1f3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:18.686286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:18.695787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:18.697116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:18.697116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:18.697817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:18.703549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:18.728876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 850/1772] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:18.733588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.745073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d705a2-d751-436a-a1c9-83428373d5c0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:18.770542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:18.771476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:18.771669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:18.772032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] PATH_INFO: `/v3/projects/0c7ac50d796946b6ba5b0c01b2c787be/users/2b3c5c1114ec4ef4930fc00942549709/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:18.793958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6454076dbecb44b0bfc1a5fd1bb6e879', 'request_id': 'req-49dfd270-64a1-482b-bdb1-37834c9e3fff'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:18.825604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7ac50d796946b6ba5b0c01b2c787be, user_id=2b3c5c1114ec4ef4930fc00942549709, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:18.830254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:18.921270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6454076dbecb44b0bfc1a5fd1bb6e879', 'request_id': 'req-49dfd270-64a1-482b-bdb1-37834c9e3fff'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:18.931989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 851/1773] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:18 2022] PUT /identity/v3/projects/0c7ac50d796946b6ba5b0c01b2c787be/users/2b3c5c1114ec4ef4930fc00942549709/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:18.935024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6454076dbecb44b0bfc1a5fd1bb6e879', 'request_id': 'req-49dfd270-64a1-482b-bdb1-37834c9e3fff'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:18.940511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.963981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] The token cache is being invalidate because project 6454076dbecb44b0bfc1a5fd1bb6e879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:18.964493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:18.965261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:18.971738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 923/1774] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:18 2022] DELETE /identity/v3/projects/6454076dbecb44b0bfc1a5fd1bb6e879 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:18.977896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.982892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.121754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdd69-d3a7-4f44-ae48-9e4897d7993f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:19.128227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:19.133074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.133074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.133074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.133074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:19.133074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:19.146070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 852/1775] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:19.153500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:19.156732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd270-64a1-482b-bdb1-37834c9e3fff admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:19.159500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.163492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:19.173119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.173119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.173119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] PATH_INFO: `/v3/users/05b3a707d8754c07adb56b8675c1b84d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.173119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b3a707d8754c07adb56b8675c1b84d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:19.173119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:19.198749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3c90-1ed4-4585-94a6-c7fc0507f5c9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:19.207004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dafff-d4a0-4761-bdaf-69ca3bd7e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:19.208153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dafff-d4a0-4761-bdaf-69ca3bd7e1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.208441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dafff-d4a0-4761-bdaf-69ca3bd7e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.208720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dafff-d4a0-4761-bdaf-69ca3bd7e1d5 admin admin] PATH_INFO: `/v3/projects/0c7ac50d796946b6ba5b0c01b2c787be/users/2b3c5c1114ec4ef4930fc00942549709/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.212012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dafff-d4a0-4761-bdaf-69ca3bd7e1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7ac50d796946b6ba5b0c01b2c787be, user_id=2b3c5c1114ec4ef4930fc00942549709, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:19.214997 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dafff-d4a0-4761-bdaf-69ca3bd7e1d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:19.249024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 853/1776] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:19 2022] PUT /identity/v3/projects/0c7ac50d796946b6ba5b0c01b2c787be/users/2b3c5c1114ec4ef4930fc00942549709/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:19.261383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.261866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.262344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.334662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] MFA Rules not processed for user `2b3c5c1114ec4ef4930fc00942549709`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:19.338368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.471729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 854/1777] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:19.492522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:19.494675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.550443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b3a707d8754c07adb56b8675c1b84d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.579194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b3a707d8754c07adb56b8675c1b84d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.588029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b3a707d8754c07adb56b8675c1b84d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.588935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b3a707d8754c07adb56b8675c1b84d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.633137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0630d2-cc12-46fe-bf89-33ad6eab8da1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:19.639764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:19.640552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.641131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.641604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.657034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:19.659231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:19.673335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 855/1778] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:19.775377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b3a707d8754c07adb56b8675c1b84d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.790434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 924/1779] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:18 2022] DELETE /identity/v3/users/05b3a707d8754c07adb56b8675c1b84d => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:20.107072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.115997 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5713-db32-4301-916b-911973296e4d service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.227618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.228721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.229050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.229576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.231325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:20.332333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.334160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d175ea7-542a-4e8a-89a2-ea742e281c31 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.353361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 856/1780] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:20.723863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.725836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:20.831143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a76c6d-a968-4a77-bc11-8d5cc0c12e1b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.837780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.838653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.839064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.839338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] PATH_INFO: `/v3/projects/11133afbfbb64c7cb3bf2a44a7be3d70` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.840719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=11133afbfbb64c7cb3bf2a44a7be3d70)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.842686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:21.090814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11133afbfbb64c7cb3bf2a44a7be3d70', 'request_id': 'req-29404706-f556-48cd-947a-c24d083ff91b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:21.280961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11133afbfbb64c7cb3bf2a44a7be3d70', 'request_id': 'req-29404706-f556-48cd-947a-c24d083ff91b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:21.302791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11133afbfbb64c7cb3bf2a44a7be3d70', 'request_id': 'req-29404706-f556-48cd-947a-c24d083ff91b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:21.327486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] The token cache is being invalidate because project 11133afbfbb64c7cb3bf2a44a7be3d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:21.328435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:21.329816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-29404706-f556-48cd-947a-c24d083ff91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:21.333679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 925/1781] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:20 2022] DELETE /identity/v3/projects/11133afbfbb64c7cb3bf2a44a7be3d70 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:21.340920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:21.342383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:21.343380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:21.391814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:21.396633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:21.567059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 857/1782] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:21.581932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08351d0a-1ad6-4bc5-9a62-f17651c4c64a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:21.582852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08351d0a-1ad6-4bc5-9a62-f17651c4c64a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:21.583788 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08351d0a-1ad6-4bc5-9a62-f17651c4c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:21.611021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-08351d0a-1ad6-4bc5-9a62-f17651c4c64a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:21.612527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-08351d0a-1ad6-4bc5-9a62-f17651c4c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:21.628633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 926/1783] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:21.659198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:21.661364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6d52-2b02-468b-9905-6aa8f6ed8391 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:21.666795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6d52-2b02-468b-9905-6aa8f6ed8391 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:21.667322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6d52-2b02-468b-9905-6aa8f6ed8391 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:21.670182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 927/1784] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:32:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:21.682665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:21.683107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:21.684230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:21.690331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d3a11-55e4-4d76-8bdc-da993732a6da None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:21.703111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:21.715061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:22.061308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.062678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:22.064850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.064850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.064850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:22.064850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.064850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:22.064850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 858/1785] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:22.065860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 928/1786] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:22.066316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:22.066316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:22.066316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae32c1-1360-485e-9c2a-9b1b03dc7ca4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:22.066962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:22.066962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.066962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.066962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.067648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.067648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:22.067648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 859/1787] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:22.067830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:22.083406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142f12-1a2e-4de8-b1b9-9f9d94ebb24b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:22.101452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:22.121041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.121041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.121041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.121041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.121041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:22.406640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 929/1788] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:22 2022] POST /identity/v3/projects => generated 385 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:22.418533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:22.462730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ed6f-1cb3-4f4c-b5fb-16ff30948af8 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:22.606097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:22.606718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.607093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.608189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.609471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.612037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:22.803741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 860/1789] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:22 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:22.810633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:22.832519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaefb0-3c92-4901-93e8-b035feb7e21c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:22.838474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:22.839349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.839820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.840299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.841090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.842988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:22.854672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 930/1790] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:22.859640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:22.880026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c988-efc7-439e-b884-a7531282a3c6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:22.888409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab7f90-ac0d-47e0-b612-3e32ab8ea4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:22.889490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7f90-ac0d-47e0-b612-3e32ab8ea4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.893268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7f90-ac0d-47e0-b612-3e32ab8ea4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.896729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7f90-ac0d-47e0-b612-3e32ab8ea4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.899591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab7f90-ac0d-47e0-b612-3e32ab8ea4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.902167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab7f90-ac0d-47e0-b612-3e32ab8ea4bb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:22.915602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 861/1791] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:22.920344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:22.932057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51ff5e-e4bd-4832-b8ea-11590e273066 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:22.937214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:22.937914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:22.938195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:22.938470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] PATH_INFO: `/v3/projects/f83c555992654286aaded53586034199/users/2752dfb061f54c4a98a8aca598c5c936/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:22.974926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83c555992654286aaded53586034199, user_id=2752dfb061f54c4a98a8aca598c5c936, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:22.979155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:23.145428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 931/1792] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:22 2022] PUT /identity/v3/projects/f83c555992654286aaded53586034199/users/2752dfb061f54c4a98a8aca598c5c936/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:23.146615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:23.146833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:23.147097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:23.189227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] MFA Rules not processed for user `2752dfb061f54c4a98a8aca598c5c936`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:23.190563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:23.267164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:23.316850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 862/1793] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:23.318631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:23.470473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec839-8339-4201-9135-e08f33db6433 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:23.477344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:23.480556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:23.480954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:23.481316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:23.482050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:23.485233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:23.684740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 932/1794] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:23 2022] POST /identity/v3/projects => generated 385 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:23.686930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:23.709697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d013260-1cb4-4db4-932f-8f21717d3b07 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:23.860189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:23.861135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:23.861695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:23.862235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:23.863130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:23.867382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.059713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 863/1795] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:23 2022] POST /identity/v3/users => generated 299 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:24.064093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:24.096004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3e4f-09dc-4857-9d30-c41ff8ba548d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:24.112082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:24.113036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.113492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.113922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.114763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:24.117078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.138870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 933/1796] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:24.151744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:24.164961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169dd01-8d91-44d8-b1f9-6a5546d12ccb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:24.169974 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:24.171672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.172350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.172886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] PATH_INFO: `/v3/projects/9187a06fd9794aa9a53ab6f381a73ab3/users/09dd90170f564c3097b9f8e6c0000422/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.202220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9187a06fd9794aa9a53ab6f381a73ab3, user_id=09dd90170f564c3097b9f8e6c0000422, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:24.205377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.346447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 864/1797] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:24 2022] PUT /identity/v3/projects/9187a06fd9794aa9a53ab6f381a73ab3/users/09dd90170f564c3097b9f8e6c0000422/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:24.350048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:24.360629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15603307-74bf-4713-aef4-db6796d4acfc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:24.431282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6cb2e-2749-4684-99f6-b62d479e0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:24.431901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6cb2e-2749-4684-99f6-b62d479e0ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.432185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6cb2e-2749-4684-99f6-b62d479e0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.432462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6cb2e-2749-4684-99f6-b62d479e0ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.433153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6cb2e-2749-4684-99f6-b62d479e0ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:24.434816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6cb2e-2749-4684-99f6-b62d479e0ae7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.446807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 934/1798] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:24.456076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:24.470749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c96ae-2ea9-4add-91f7-c83768b051c1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:24.484552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:24.484552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.484552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.484552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] PATH_INFO: `/v3/projects/9187a06fd9794aa9a53ab6f381a73ab3/users/09dd90170f564c3097b9f8e6c0000422/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.486665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9187a06fd9794aa9a53ab6f381a73ab3, user_id=09dd90170f564c3097b9f8e6c0000422, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:24.490202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.510416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 865/1799] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:24 2022] PUT /identity/v3/projects/9187a06fd9794aa9a53ab6f381a73ab3/users/09dd90170f564c3097b9f8e6c0000422/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:24.525459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.525459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.525459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.580542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] MFA Rules not processed for user `09dd90170f564c3097b9f8e6c0000422`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:24.582476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:24.728979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 935/1800] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:25.047413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:25.049574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:25.132703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303c2d-9ce3-4726-9116-1d6c1b382250 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:25.136944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3824d-36ce-46dc-975e-d25ff3f00b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:25.137853 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3824d-36ce-46dc-975e-d25ff3f00b46 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:25.138309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3824d-36ce-46dc-975e-d25ff3f00b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:25.138715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3824d-36ce-46dc-975e-d25ff3f00b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:25.150147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3824d-36ce-46dc-975e-d25ff3f00b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:25.151724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3824d-36ce-46dc-975e-d25ff3f00b46 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:25.166802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 866/1801] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:25.209098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:25.448016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ee1ba-cc8c-4500-9243-af419a552a16 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:25.455287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:25.471810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:25.471810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:25.471810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] PATH_INFO: `/v3/users/2752dfb061f54c4a98a8aca598c5c936` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:25.471810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2752dfb061f54c4a98a8aca598c5c936)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:25.471810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:25.821809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2752dfb061f54c4a98a8aca598c5c936'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:25.837305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2752dfb061f54c4a98a8aca598c5c936'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:25.857421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2752dfb061f54c4a98a8aca598c5c936'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:25.857645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2752dfb061f54c4a98a8aca598c5c936'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:26.038035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2752dfb061f54c4a98a8aca598c5c936'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:26.047612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 936/1802] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:25 2022] DELETE /identity/v3/users/2752dfb061f54c4a98a8aca598c5c936 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:26.052260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:26.056998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:26.056998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:26.083609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:26.085012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:26.226838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 867/1803] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:26.226838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:26.229425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:26.231273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:26.329299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f985-0816-405c-b857-32c3c3cd5db6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:26.334961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:26.336742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:26.337399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:26.337896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:26.400785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:26.402386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:26.415378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 937/1804] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:27.361961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:27.365233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:27.367253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:27.397368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149b99-ab4b-4c14-b2d6-483379f8817a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:27.424410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:27.425127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:27.425401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:27.425674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] PATH_INFO: `/v3/projects/f83c555992654286aaded53586034199` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:27.427005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83c555992654286aaded53586034199)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:27.435036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:27.597180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83c555992654286aaded53586034199', 'request_id': 'req-8a759359-fcb1-4216-b227-20aecfa00a1c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:27.737856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83c555992654286aaded53586034199', 'request_id': 'req-8a759359-fcb1-4216-b227-20aecfa00a1c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:27.750381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83c555992654286aaded53586034199', 'request_id': 'req-8a759359-fcb1-4216-b227-20aecfa00a1c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:27.767417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] The token cache is being invalidate because project f83c555992654286aaded53586034199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:27.767703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:27.768659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:27.770382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 868/1805] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:27 2022] DELETE /identity/v3/projects/f83c555992654286aaded53586034199 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:27.775092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:27.793068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d53b-13a6-4271-ae1c-235284e2ad11 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:27.893888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:27.893888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:27.893888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:27.893888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] PATH_INFO: `/v3/users/09dd90170f564c3097b9f8e6c0000422` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:27.894453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dd90170f564c3097b9f8e6c0000422)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:27.894601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:28.286180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dd90170f564c3097b9f8e6c0000422'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:28.310199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dd90170f564c3097b9f8e6c0000422'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:28.321045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dd90170f564c3097b9f8e6c0000422'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:28.322459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dd90170f564c3097b9f8e6c0000422'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:28.506440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-246fee9d-8960-4b4f-906a-392378e243ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dd90170f564c3097b9f8e6c0000422'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:28.517519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 938/1806] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:27 2022] DELETE /identity/v3/users/09dd90170f564c3097b9f8e6c0000422 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:29.136180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:29.138554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:29.159291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759359-fcb1-4216-b227-20aecfa00a1c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:29.247770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:29.248614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.249134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.249565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] PATH_INFO: `/v3/projects/9187a06fd9794aa9a53ab6f381a73ab3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.250894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9187a06fd9794aa9a53ab6f381a73ab3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:29.253127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:29.389388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9187a06fd9794aa9a53ab6f381a73ab3', 'request_id': 'req-ecf56e89-b3b6-4192-8202-83089ddbfd5b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:29.551809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9187a06fd9794aa9a53ab6f381a73ab3', 'request_id': 'req-ecf56e89-b3b6-4192-8202-83089ddbfd5b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:29.561791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9187a06fd9794aa9a53ab6f381a73ab3', 'request_id': 'req-ecf56e89-b3b6-4192-8202-83089ddbfd5b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:29.578862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] The token cache is being invalidate because project 9187a06fd9794aa9a53ab6f381a73ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:29.578862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:29.579599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ecf56e89-b3b6-4192-8202-83089ddbfd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:29.581782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 869/1807] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:29 2022] DELETE /identity/v3/projects/9187a06fd9794aa9a53ab6f381a73ab3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:29.588033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.588537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.588635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.611114 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:29.613784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:29.694179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 939/1808] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:29.702302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.702592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.702875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.730682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:29.730682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:29.739259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 870/1809] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:29.744821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:29.757689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e9f9b-4006-4866-819f-a83998533ba6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:29.763868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:29.764487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.764770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.765066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.765722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:29.766027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:29.767656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:29.781701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 940/1810] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:29.791793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:29.805809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5b3fc-b428-4299-8dac-3ff4d6cc4bc1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:29.813518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:29.813518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.813518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.813518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.813976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:29.814627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:29.982676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 871/1811] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:29 2022] POST /identity/v3/projects => generated 393 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:29.986076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:29.997836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2d88-055c-4128-ac49-eb3fbe8ac801 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:30.085575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:30.086188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:30.086470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:30.086746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:30.087395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:30.089361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:30.302750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 941/1812] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:29 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:30.305147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:30.337742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef69f-a432-46bd-ac76-c9d7aff5a13e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:30.358868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:30.359829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:30.360182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:30.360653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:30.361902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:30.369220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:30.392177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 872/1813] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:30.399033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:30.410614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65365-6b75-475e-b7c4-e2e9663b0230 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:30.416214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260654fb-dd47-4bc5-9dc1-d078a21cd7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:30.416959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260654fb-dd47-4bc5-9dc1-d078a21cd7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:30.417321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260654fb-dd47-4bc5-9dc1-d078a21cd7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:30.417676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260654fb-dd47-4bc5-9dc1-d078a21cd7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:30.418635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260654fb-dd47-4bc5-9dc1-d078a21cd7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:30.421136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260654fb-dd47-4bc5-9dc1-d078a21cd7ee admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:30.442904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 942/1814] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:30.448141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:30.467222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4d27-37a9-4386-9967-b8d6d4c8d955 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:30.490289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:30.492179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:30.492827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:30.493435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] PATH_INFO: `/v3/projects/f7cabeae68e449849222fbcbc9a07dc4/users/a3323a7665e84c65af7f5deb84fc59b9/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:30.535724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cabeae68e449849222fbcbc9a07dc4, user_id=a3323a7665e84c65af7f5deb84fc59b9, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:30.540838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:30.656202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 873/1815] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:30 2022] PUT /identity/v3/projects/f7cabeae68e449849222fbcbc9a07dc4/users/a3323a7665e84c65af7f5deb84fc59b9/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:30.667572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:30.668427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:30.668427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:30.721414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] MFA Rules not processed for user `a3323a7665e84c65af7f5deb84fc59b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:30.723870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:30.900130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 943/1816] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:30.905399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:30.994649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:30.996484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:31.074411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b2f21-c768-44d0-9e92-d540c74eacd7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:31.087981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:31.088627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.088940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.089221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.089891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:31.098153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:31.162234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d75ec-0651-4f39-acd0-3921ee28a977 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:31.182027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:31.182904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.183212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.183483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] PATH_INFO: `/v3/users/ae95e87956864dd19297b9e4c0a31193` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.184967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae95e87956864dd19297b9e4c0a31193)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:31.187836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:31.299598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 874/1817] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:30 2022] POST /identity/v3/projects => generated 391 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:31.303747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.397098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911e6a-9d03-4e8d-881e-1f3e63a60f09 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:31.407996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:31.409089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.409604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.410108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.410979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:31.414592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:31.526400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae95e87956864dd19297b9e4c0a31193'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.543238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae95e87956864dd19297b9e4c0a31193'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.553632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae95e87956864dd19297b9e4c0a31193'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.555517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae95e87956864dd19297b9e4c0a31193'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.602392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 875/1818] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:31 2022] POST /identity/v3/users => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:31.611364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.623219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37960221-c40b-482b-aae0-dafe7e97c003 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:31.628237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:31.628992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.629460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.630038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.630691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:31.633085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:31.646504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 876/1819] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:31.651131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.676351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc6d33-723d-4d26-9614-0d039a4d063e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:31.686335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:31.687396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.687938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.688327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] PATH_INFO: `/v3/projects/ff31243fb74b4a828fd9785825928d13/users/81ac1bf1362f4a9788deab19909fa2a7/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.724545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff31243fb74b4a828fd9785825928d13, user_id=81ac1bf1362f4a9788deab19909fa2a7, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:31.725971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a19b8e8a-24d3-40d1-a5a0-5b417e433241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae95e87956864dd19297b9e4c0a31193'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.728523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:31.733337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 944/1820] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:30 2022] DELETE /identity/v3/users/ae95e87956864dd19297b9e4c0a31193 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:31.738059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.738349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.738631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.787014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:31.789461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:31.863091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 877/1821] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:31 2022] PUT /identity/v3/projects/ff31243fb74b4a828fd9785825928d13/users/81ac1bf1362f4a9788deab19909fa2a7/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:31.868229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.873017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:31.889272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 945/1822] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:31.895591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.898248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:32.019020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef8c6f-226d-434e-8d98-88470c76f440 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.041812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:32.050560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3f9a6-7a2e-4885-baaa-f73c875df932 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.064570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.065588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.065965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.066248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.067170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.069164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.093968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 878/1823] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:32.095287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:32.110865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f942df-ab1d-41e7-9773-edff448e5864 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.146933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828773b-ce66-4550-b25d-48ec801fc725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.148590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828773b-ce66-4550-b25d-48ec801fc725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.149022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828773b-ce66-4550-b25d-48ec801fc725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.149555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828773b-ce66-4550-b25d-48ec801fc725 admin admin] PATH_INFO: `/v3/projects/ff31243fb74b4a828fd9785825928d13/users/81ac1bf1362f4a9788deab19909fa2a7/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.152262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828773b-ce66-4550-b25d-48ec801fc725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff31243fb74b4a828fd9785825928d13, user_id=81ac1bf1362f4a9788deab19909fa2a7, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.157012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828773b-ce66-4550-b25d-48ec801fc725 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.157932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.158950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.159245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.159522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.170626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.172127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.176046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 879/1824] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:32 2022] PUT /identity/v3/projects/ff31243fb74b4a828fd9785825928d13/users/81ac1bf1362f4a9788deab19909fa2a7/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:32.182861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 946/1825] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:32.193927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.194349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.194733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.230678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] MFA Rules not processed for user `81ac1bf1362f4a9788deab19909fa2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:32.231901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:32.333364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 880/1826] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:32.344762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:32.346274 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:32.418054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257445-3ac8-4e39-a278-244ea9172c85 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.481866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.482769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.483146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.483466 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.497205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.498672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.533108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 947/1827] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:32.597930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:32.608907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac167eb-7e9b-4cde-b53a-7570141b1012 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.613255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.613990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.614377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.614740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.616672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:32.721865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.723381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.743330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:32.745392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 881/1828] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:32.961908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:32.965646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:33.079150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f76b-008f-49c3-8e19-d8c8d52d3592 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:33.087137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:33.088307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:33.088744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:33.089202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] PATH_INFO: `/v3/projects/688d667198064413b490626201b41047` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:33.091104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=688d667198064413b490626201b41047)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:33.095215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:33.360990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688d667198064413b490626201b41047', 'request_id': 'req-30242609-91c7-44af-8ad8-bd2dc4ba7bed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:33.525822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688d667198064413b490626201b41047', 'request_id': 'req-30242609-91c7-44af-8ad8-bd2dc4ba7bed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:33.533848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688d667198064413b490626201b41047', 'request_id': 'req-30242609-91c7-44af-8ad8-bd2dc4ba7bed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:33.572120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] The token cache is being invalidate because project 688d667198064413b490626201b41047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:33.572120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:33.580362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:33.582418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 948/1829] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:32 2022] DELETE /identity/v3/projects/688d667198064413b490626201b41047 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:33.588998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:33.610397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a52581-6b2a-43c5-810b-f55018465029 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:33.736517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:33.737863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:33.739267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:33.739267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] PATH_INFO: `/v3/users/2b3c5c1114ec4ef4930fc00942549709` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:33.743082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3c5c1114ec4ef4930fc00942549709)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:33.746041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:34.108834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3c5c1114ec4ef4930fc00942549709'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:34.109711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3c5c1114ec4ef4930fc00942549709'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:34.129783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3c5c1114ec4ef4930fc00942549709'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:34.139544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3c5c1114ec4ef4930fc00942549709'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:34.140396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b724e266-8428-4eb3-b220-a0cf90002eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3c5c1114ec4ef4930fc00942549709'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:34.279109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 882/1830] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:33 2022] DELETE /identity/v3/users/2b3c5c1114ec4ef4930fc00942549709 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:34.818093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:34.819724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:34.836559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30242609-91c7-44af-8ad8-bd2dc4ba7bed admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:34.918503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:34.918930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:34.919221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:34.919498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] PATH_INFO: `/v3/projects/0c7ac50d796946b6ba5b0c01b2c787be` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:34.920895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7ac50d796946b6ba5b0c01b2c787be)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:34.923045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:35.212450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7ac50d796946b6ba5b0c01b2c787be', 'request_id': 'req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:35.474563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7ac50d796946b6ba5b0c01b2c787be', 'request_id': 'req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:35.484254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7ac50d796946b6ba5b0c01b2c787be', 'request_id': 'req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:35.498202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] The token cache is being invalidate because project 0c7ac50d796946b6ba5b0c01b2c787be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:35.498701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:35.499610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bc19ea-69f4-4ee8-a5a9-dfedf79cc8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:35.501902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 949/1831] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:34 2022] DELETE /identity/v3/projects/0c7ac50d796946b6ba5b0c01b2c787be => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:35.510478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9d57-c044-4350-9f07-4b397797892c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:35.510478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9d57-c044-4350-9f07-4b397797892c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:35.510478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9d57-c044-4350-9f07-4b397797892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:35.542050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-120f9d57-c044-4350-9f07-4b397797892c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:35.543935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-120f9d57-c044-4350-9f07-4b397797892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:35.635223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 883/1832] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:35.644912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:35.645286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:35.645644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:35.669592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:35.671135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:35.681586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 950/1833] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:35.685965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9d57-c044-4350-9f07-4b397797892c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:35.701279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9d57-c044-4350-9f07-4b397797892c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:35.707023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:35.710887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:35.710887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:35.710887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:35.710887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:35.710887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:35.710887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:35.725045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 884/1834] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:35.729417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:35.739158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a162-dcb5-4330-b20d-e70541c93936 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:35.745084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:35.756691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:35.757213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:35.757512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:35.758328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:35.768685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:35.939377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 951/1835] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:35 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:35.940964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:35.954058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727d75e-c1d4-488d-be0a-174a5fe42cea admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:36.030675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:36.031718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:36.032456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:36.032974 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:36.034135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:36.038113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:36.132347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:36.165882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 885/1836] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:35 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:36.170414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:36.184536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66ac1-6d04-4bae-b64c-dce963c49da8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:36.189799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:36.190456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:36.190740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:36.191016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:36.191688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:36.193573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:36.210786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 952/1837] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:36.212060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:36.223155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b09a-498f-4d5d-a1ae-28e077665ad0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:36.230533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01ea5-4ef2-4314-b564-7808f2e01907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:36.231092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01ea5-4ef2-4314-b564-7808f2e01907 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:36.231365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01ea5-4ef2-4314-b564-7808f2e01907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:36.231796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01ea5-4ef2-4314-b564-7808f2e01907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:36.232975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba01ea5-4ef2-4314-b564-7808f2e01907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:36.235463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba01ea5-4ef2-4314-b564-7808f2e01907 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:36.251991 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 886/1838] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:36.258950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:36.283541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5b66-03d8-4ada-a161-d22f2cb38b43 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:36.289786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:36.290494 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:36.290781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:36.291059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] PATH_INFO: `/v3/projects/b108f2ec7808411394c48ff0094ae746/users/ecd9ff73e6c14b9c9930540c4450f907/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:36.309832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b108f2ec7808411394c48ff0094ae746, user_id=ecd9ff73e6c14b9c9930540c4450f907, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:36.315597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:36.549069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 953/1839] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:36 2022] PUT /identity/v3/projects/b108f2ec7808411394c48ff0094ae746/users/ecd9ff73e6c14b9c9930540c4450f907/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:36.560312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:36.560905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:36.561006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:36.600333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] MFA Rules not processed for user `ecd9ff73e6c14b9c9930540c4450f907`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:36.602716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:36.715767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:36.817322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 887/1840] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:36.824304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:36.923249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9d3f-e917-400b-a951-d7c3ffac6f7f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:36.929299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:36.930154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:36.930580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:36.930991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:36.932082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:36.935292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:37.091905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 954/1841] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:36 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:37.096009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:37.124722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3c17-7661-46fc-bd4d-1302c6387aad None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:37.145739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:37.156583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:37.235240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:37.236197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:37.236642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:37.237134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:37.237938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:37.240403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:37.284468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7783ed-0af5-4245-a9bf-6db2d8b62f26 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:37.297151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:37.304457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:37.304457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:37.304457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] PATH_INFO: `/v3/users/9b6c623174924e8fa029fd080debebcd` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:37.304457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6c623174924e8fa029fd080debebcd)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:37.304457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:37.370974 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 888/1842] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:37 2022] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:37.373592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:37.402549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d27cc-5d98-4afb-aead-c46255f43573 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:37.407920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:37.408880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:37.408880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:37.409506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:37.410019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:37.411697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:37.425128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 889/1843] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:37.429805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:37.446984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ac47d-a24c-4153-b4dc-864db2381894 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:37.452428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:37.453358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:37.453833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:37.454243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] PATH_INFO: `/v3/projects/b44c60177b684dd8ac3e89cd18ce0be1/users/1b20b9de15ec4985ae8c7e2a7e8573b4/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:37.474486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44c60177b684dd8ac3e89cd18ce0be1, user_id=1b20b9de15ec4985ae8c7e2a7e8573b4, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:37.477589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:37.618356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6c623174924e8fa029fd080debebcd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:37.630993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6c623174924e8fa029fd080debebcd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:37.638547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6c623174924e8fa029fd080debebcd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:37.639296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6c623174924e8fa029fd080debebcd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:37.676597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 890/1844] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:37 2022] PUT /identity/v3/projects/b44c60177b684dd8ac3e89cd18ce0be1/users/1b20b9de15ec4985ae8c7e2a7e8573b4/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:37.685799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:37.814914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4a8b317-4ad0-4e4e-872b-6616946f1504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6c623174924e8fa029fd080debebcd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:37.814914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 955/1845] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:37 2022] DELETE /identity/v3/users/9b6c623174924e8fa029fd080debebcd => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:37.818361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:37.818657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:37.818939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:37.828320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa962d-e266-43f3-be68-4f5e2644ee9f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:37.840276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:37.840875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:37.968196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 956/1846] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:37.969123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:37.969934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:37.970253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:37.977170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:37.977886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:37.979720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:37.979944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:37.981800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:37.995135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 891/1847] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:38.009820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:38.009820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:38.029692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4532ad-5bbc-4c0a-9fdf-0d83bc91e904 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:38.034772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546792f-f803-49a9-b9bc-bc8c0f7ecb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:38.035492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546792f-f803-49a9-b9bc-bc8c0f7ecb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:38.036854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546792f-f803-49a9-b9bc-bc8c0f7ecb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:38.036854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546792f-f803-49a9-b9bc-bc8c0f7ecb83 admin admin] PATH_INFO: `/v3/projects/b44c60177b684dd8ac3e89cd18ce0be1/users/1b20b9de15ec4985ae8c7e2a7e8573b4/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:38.039384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546792f-f803-49a9-b9bc-bc8c0f7ecb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44c60177b684dd8ac3e89cd18ce0be1, user_id=1b20b9de15ec4985ae8c7e2a7e8573b4, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:38.042483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546792f-f803-49a9-b9bc-bc8c0f7ecb83 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:38.057993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 892/1848] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:37 2022] PUT /identity/v3/projects/b44c60177b684dd8ac3e89cd18ce0be1/users/1b20b9de15ec4985ae8c7e2a7e8573b4/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:38.068077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:38.068382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:38.068642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:38.083093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1bc9-3411-4e0d-a52a-6816cc2ab2cb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:38.107985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] MFA Rules not processed for user `1b20b9de15ec4985ae8c7e2a7e8573b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:38.109316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:38.210490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:38.210490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:38.210490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:38.210490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:38.238552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 893/1849] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:38.320865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:38.326007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:38.340017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 957/1850] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:38.586679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:38.588560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:38.669198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf9989-a66e-46ff-a7a4-284122bb32f7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:38.673360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:38.674184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:38.674468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:38.674745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:38.685420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:38.686983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:38.703318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 894/1851] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:38.983489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:38.995644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fd2f0-d065-4782-9ae2-dd8ba03ad446 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:39.000335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:39.001304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:39.001873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:39.002385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:39.004830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:39.142916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:39.144505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:39.155601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 958/1852] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:39.243810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:39.246951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:39.265568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc60db3-d9db-4d26-80a3-978dc215733d service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:39.272170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:39.273724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:39.274147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:39.274697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] PATH_INFO: `/v3/projects/ae43d6e7c4ec496b9ad88e405e317a71` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:39.276026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae43d6e7c4ec496b9ad88e405e317a71)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:39.279819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:39.507278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae43d6e7c4ec496b9ad88e405e317a71', 'request_id': 'req-83e07b35-30d5-40f2-9531-8248bcc50af2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:39.684775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae43d6e7c4ec496b9ad88e405e317a71', 'request_id': 'req-83e07b35-30d5-40f2-9531-8248bcc50af2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:39.690440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae43d6e7c4ec496b9ad88e405e317a71', 'request_id': 'req-83e07b35-30d5-40f2-9531-8248bcc50af2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:39.706005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] The token cache is being invalidate because project ae43d6e7c4ec496b9ad88e405e317a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:39.706398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:39.707430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:39.709455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 895/1853] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:39 2022] DELETE /identity/v3/projects/ae43d6e7c4ec496b9ad88e405e317a71 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:39.717984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:39.735179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c187-a07f-4591-806a-cc524d3041e7 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:39.809451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:39.810117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:39.810407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:39.810781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] PATH_INFO: `/v3/users/4730b13837234c49aab3f00149b70351` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:39.812389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4730b13837234c49aab3f00149b70351)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:39.814463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:39.955694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:39.958174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:39.977873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e07b35-30d5-40f2-9531-8248bcc50af2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:39.989734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:39.991146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:39.991585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:39.992004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] PATH_INFO: `/v3/users/ecd9ff73e6c14b9c9930540c4450f907` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:39.998333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd9ff73e6c14b9c9930540c4450f907)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:39.999538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:40.325876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4730b13837234c49aab3f00149b70351'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.366714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4730b13837234c49aab3f00149b70351'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.379197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd9ff73e6c14b9c9930540c4450f907'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.380845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd9ff73e6c14b9c9930540c4450f907'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.385241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4730b13837234c49aab3f00149b70351'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.394423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4730b13837234c49aab3f00149b70351'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.403293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd9ff73e6c14b9c9930540c4450f907'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.411028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd9ff73e6c14b9c9930540c4450f907'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.412347 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd9ff73e6c14b9c9930540c4450f907'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.575001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a1fe676-65f7-417a-87c3-c38ecefbd0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4730b13837234c49aab3f00149b70351'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:40.597584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 959/1854] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:39 2022] DELETE /identity/v3/users/4730b13837234c49aab3f00149b70351 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:40.718522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 896/1855] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:39 2022] DELETE /identity/v3/users/ecd9ff73e6c14b9c9930540c4450f907 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:40.723285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:40.723834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:40.723834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:40.745688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:40.769725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:40.804358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:40.811873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 960/1856] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:40.822529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:40.824001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:40.890105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4493c-4565-46a8-bd3a-8598619355a5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:40.906600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10635f-79f0-47e8-978f-68ce07ed86c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:40.907954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10635f-79f0-47e8-978f-68ce07ed86c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:40.908221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10635f-79f0-47e8-978f-68ce07ed86c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:40.908839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10635f-79f0-47e8-978f-68ce07ed86c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:40.925212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10635f-79f0-47e8-978f-68ce07ed86c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:40.926683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10635f-79f0-47e8-978f-68ce07ed86c5 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:40.951950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 897/1857] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:40.994029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:40.996508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:41.013041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ac6e4-1e76-425b-b829-a181a5378f86 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:41.023809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:41.025236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:41.029885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:41.029885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] PATH_INFO: `/v3/users/a3323a7665e84c65af7f5deb84fc59b9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:41.029885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3323a7665e84c65af7f5deb84fc59b9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:41.029885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:41.112156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:41.345140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3323a7665e84c65af7f5deb84fc59b9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:41.366469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3323a7665e84c65af7f5deb84fc59b9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:41.394480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3323a7665e84c65af7f5deb84fc59b9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:41.395473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3323a7665e84c65af7f5deb84fc59b9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:41.580257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3323a7665e84c65af7f5deb84fc59b9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:41.592243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 961/1858] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:40 2022] DELETE /identity/v3/users/a3323a7665e84c65af7f5deb84fc59b9 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:41.596533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:41.596835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:41.597143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:41.625096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:41.626383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:41.730294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 898/1859] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:41.743764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:41.746254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:41.846431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4347-0e89-485d-b120-9fddaac06296 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:41.859078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:41.860097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:41.860579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:41.861082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:41.873610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:41.875347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:41.887526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 962/1860] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:41.962058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:41.964795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:41.980500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:41.982330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:41.998602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837d3a-5e9a-42e6-add7-1d1814695e38 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:42.008248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:42.010737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a26321-4381-4fce-84fb-c9ce909cb3f5 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:42.016421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:42.017367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.017831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.018264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] PATH_INFO: `/v3/projects/da41768ea58243b0b02728fb7667eaf5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.019666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=da41768ea58243b0b02728fb7667eaf5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:42.021690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.021989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.022258 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:42.022367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] PATH_INFO: `/v3/projects/b108f2ec7808411394c48ff0094ae746` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.024280 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b108f2ec7808411394c48ff0094ae746)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:42.026475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:42.262669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b108f2ec7808411394c48ff0094ae746', 'request_id': 'req-15a21632-ce49-46fe-a6bb-951e7a245886'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.268022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da41768ea58243b0b02728fb7667eaf5', 'request_id': 'req-82bf8a54-289d-4156-b329-0f7196c9f1df'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.385701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b108f2ec7808411394c48ff0094ae746', 'request_id': 'req-15a21632-ce49-46fe-a6bb-951e7a245886'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.393937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b108f2ec7808411394c48ff0094ae746', 'request_id': 'req-15a21632-ce49-46fe-a6bb-951e7a245886'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.416432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] The token cache is being invalidate because project b108f2ec7808411394c48ff0094ae746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:42.416692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.417420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.419399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 899/1861] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:41 2022] DELETE /identity/v3/projects/b108f2ec7808411394c48ff0094ae746 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:42.423783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:42.426032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:42.527282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21632-ce49-46fe-a6bb-951e7a245886 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:42.534790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:42.535485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.535792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.536071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] PATH_INFO: `/v3/users/1b20b9de15ec4985ae8c7e2a7e8573b4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.542170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b20b9de15ec4985ae8c7e2a7e8573b4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:42.542170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:42.548440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da41768ea58243b0b02728fb7667eaf5', 'request_id': 'req-82bf8a54-289d-4156-b329-0f7196c9f1df'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.557251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da41768ea58243b0b02728fb7667eaf5', 'request_id': 'req-82bf8a54-289d-4156-b329-0f7196c9f1df'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.575407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] The token cache is being invalidate because project da41768ea58243b0b02728fb7667eaf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:42.576094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.577308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82bf8a54-289d-4156-b329-0f7196c9f1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.585750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 963/1862] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:41 2022] DELETE /identity/v3/projects/da41768ea58243b0b02728fb7667eaf5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:42.595884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b68a7-9420-454a-93f8-19ab2111222a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.595884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b68a7-9420-454a-93f8-19ab2111222a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.595884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b68a7-9420-454a-93f8-19ab2111222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.618643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-583b68a7-9420-454a-93f8-19ab2111222a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:42.620357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-583b68a7-9420-454a-93f8-19ab2111222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:42.656656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 964/1863] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:42.658367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.658680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.658937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.694058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:42.696366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:42.710459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 965/1864] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:42.715377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:42.727964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dc2c4-87d9-4454-880d-9cc1bd81a24b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:42.733483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:42.734229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.734511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.734851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.735706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:42.736058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:42.737815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:42.752248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 966/1865] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:32:42.756932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:42.766630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950c43a-200f-4fa6-b17d-94ed044c85b7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:42.771510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:42.772907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.773230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.773507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.774159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:42.776161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:42.831593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b20b9de15ec4985ae8c7e2a7e8573b4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.832348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b20b9de15ec4985ae8c7e2a7e8573b4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.847108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b20b9de15ec4985ae8c7e2a7e8573b4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.855945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b20b9de15ec4985ae8c7e2a7e8573b4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.857014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b20b9de15ec4985ae8c7e2a7e8573b4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:42.901328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 967/1866] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:42 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:42.905785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:42.907791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:42.987283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff32e8-00b0-462c-b3a8-1a57dac3a081 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:42.993910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:42.994572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:42.994860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:42.995248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:42.995948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:42.998259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:43.026129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 900/1867] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:42 2022] DELETE /identity/v3/users/1b20b9de15ec4985ae8c7e2a7e8573b4 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:43.176148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 968/1868] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:42 2022] POST /identity/v3/users => generated 284 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:43.184694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:43.244040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea928d6-c3eb-40f3-9a5e-386e04a39c4b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:43.248664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:43.249307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.249586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.249864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.250513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:43.252120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:43.263896 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 901/1869] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:43.267775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:43.288524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6f055-f6db-423b-bae4-177e98fce95b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:43.288524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:43.288524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.288524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.288876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.288876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:43.291160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:43.293027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:43.303018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:43.315686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41af76-95d5-4c34-8c47-caac1380300d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:43.328221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 969/1870] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:43.331098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:43.332161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:43.333065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.333494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.334542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] PATH_INFO: `/v3/projects/f7cabeae68e449849222fbcbc9a07dc4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.347699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cabeae68e449849222fbcbc9a07dc4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:43.350481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:43.394406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570f63-7942-4083-b51f-295ae461aae6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:43.410001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46526f5-485b-4dee-aa02-2b82d99d28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:43.411130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46526f5-485b-4dee-aa02-2b82d99d28b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.411595 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46526f5-485b-4dee-aa02-2b82d99d28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.412293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46526f5-485b-4dee-aa02-2b82d99d28b7 admin admin] PATH_INFO: `/v3/projects/16d7f27fccc04a4caed936b83780f0bd/users/2963eaad0a1a4d7890719584d706bfaf/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.432031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46526f5-485b-4dee-aa02-2b82d99d28b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d7f27fccc04a4caed936b83780f0bd, user_id=2963eaad0a1a4d7890719584d706bfaf, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:43.434904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46526f5-485b-4dee-aa02-2b82d99d28b7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:43.600635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 970/1871] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:43 2022] PUT /identity/v3/projects/16d7f27fccc04a4caed936b83780f0bd/users/2963eaad0a1a4d7890719584d706bfaf/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:43.612769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.613633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.613924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.621730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cabeae68e449849222fbcbc9a07dc4', 'request_id': 'req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:43.662656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] MFA Rules not processed for user `2963eaad0a1a4d7890719584d706bfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:43.664408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:43.710303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:43.753902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cabeae68e449849222fbcbc9a07dc4', 'request_id': 'req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:43.766979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cabeae68e449849222fbcbc9a07dc4', 'request_id': 'req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:43.776513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 971/1872] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:43.784939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:43.790304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] The token cache is being invalidate because project f7cabeae68e449849222fbcbc9a07dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:43.790615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:43.791279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:43.796186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 902/1873] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:43 2022] DELETE /identity/v3/projects/f7cabeae68e449849222fbcbc9a07dc4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:43.797716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:43.799875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:43.902553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b6c02-72c7-416e-898b-0d05c1ca2f5d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:43.911179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:43.914227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.914227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.914227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] PATH_INFO: `/v3/users/81ac1bf1362f4a9788deab19909fa2a7` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.914582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6e4c-572f-4071-986b-8009d1729c36 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:43.916521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ac1bf1362f4a9788deab19909fa2a7)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:43.919130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:43.929451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:43.930098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:43.930815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:43.930815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:43.931286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:43.937596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:44.118438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 972/1874] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:43 2022] POST /identity/v3/projects => generated 369 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:44.119553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:44.121472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:44.215254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:44.227877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ecb5-204d-4943-8dae-ded0c4abd28b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:44.234074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ac1bf1362f4a9788deab19909fa2a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.235935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ac1bf1362f4a9788deab19909fa2a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.240214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:44.243084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.243783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.244344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] PATH_INFO: `/v3/projects/b44c60177b684dd8ac3e89cd18ce0be1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.246297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44c60177b684dd8ac3e89cd18ce0be1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:44.248577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:44.283978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ac1bf1362f4a9788deab19909fa2a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.304604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ac1bf1362f4a9788deab19909fa2a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.306428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ac1bf1362f4a9788deab19909fa2a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.486872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 903/1875] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:43 2022] DELETE /identity/v3/users/81ac1bf1362f4a9788deab19909fa2a7 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:44.491247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:44.492246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:44.506013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44c60177b684dd8ac3e89cd18ce0be1', 'request_id': 'req-82d0c655-1721-4659-b90c-b20e15b63981'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.581357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5025db5-e325-415d-86e4-01c3f595783d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:44.653282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:44.653948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.654257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.654557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.655202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:44.657308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:44.685151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44c60177b684dd8ac3e89cd18ce0be1', 'request_id': 'req-82d0c655-1721-4659-b90c-b20e15b63981'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.692116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44c60177b684dd8ac3e89cd18ce0be1', 'request_id': 'req-82d0c655-1721-4659-b90c-b20e15b63981'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.705010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] The token cache is being invalidate because project b44c60177b684dd8ac3e89cd18ce0be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:44.705306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.705992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-82d0c655-1721-4659-b90c-b20e15b63981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:44.707654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 973/1876] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:44 2022] DELETE /identity/v3/projects/b44c60177b684dd8ac3e89cd18ce0be1 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:44.713616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d44fa0-af5f-46c6-884f-f5a98b56bd48 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.714130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d44fa0-af5f-46c6-884f-f5a98b56bd48 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.714420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d44fa0-af5f-46c6-884f-f5a98b56bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.735794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b3d44fa0-af5f-46c6-884f-f5a98b56bd48 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:44.737470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b3d44fa0-af5f-46c6-884f-f5a98b56bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:44.754366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 974/1877] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:44.756936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.760253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.760253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.788251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:44.789520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:44.810252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 904/1878] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:44 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:44.811002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 975/1879] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:44.811092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:44.812798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:44.813475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:44.834569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cab71-a56f-438a-8a65-cef010ba93d1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:44.838211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d6ad4-e445-4943-a273-023714aa09cd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:44.842727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:44.843522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.843916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.844294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.845435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:44.845832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:44.847672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:44.847861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:44.848354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.848787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.880912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.880912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:44.880912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:44.883854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 976/1880] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:44.884001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 905/1881] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:44.891766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:44.891982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:44.906836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391abf-0acb-42c8-bb5a-af1d7c4ed7ad admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:44.915997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bed3cf-a9b7-4fdd-a7df-7a791b3baae6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:44.917359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:44.918118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.918345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.919006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] PATH_INFO: `/v3/projects/9cc05deff4104ec4a734b4a63b3bb3cd/users/5f69fbb373274f99ad97bcb2bd3bb5ba/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.922154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:44.922862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:44.923211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:44.923585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:44.924904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:44.926484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:44.945536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc05deff4104ec4a734b4a63b3bb3cd, user_id=5f69fbb373274f99ad97bcb2bd3bb5ba, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:44.948780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.079247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 906/1882] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:44 2022] PUT /identity/v3/projects/9cc05deff4104ec4a734b4a63b3bb3cd/users/5f69fbb373274f99ad97bcb2bd3bb5ba/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:45.080476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 977/1883] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:44 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:45.081125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.081702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.093091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:45.182047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03476374-7bd9-4f0b-b8f5-47738d594bd1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.188217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.189763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.190224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.190513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.191608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.193490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.208697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 978/1884] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:45.209684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.210848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfde2e1-4263-42e8-b359-a23d44862993 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.217960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.218795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.219112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.219388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] PATH_INFO: `/v3/projects/ff31243fb74b4a828fd9785825928d13` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.220818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff31243fb74b4a828fd9785825928d13)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.221672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8386b7-e8b9-4ca7-8710-6db4fdef63ba admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.223711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.229530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.230490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.231051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.231624 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.233123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.236532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.386613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 979/1885] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:45 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:45.386613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.395213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3429-7eb1-402a-a8ee-b45ca253a061 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.402877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff31243fb74b4a828fd9785825928d13', 'request_id': 'req-2e5d550d-f8f7-4f79-a66d-05162bf2c963'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:45.493229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.494111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.494402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.494682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] PATH_INFO: `/v3/projects/9cc05deff4104ec4a734b4a63b3bb3cd/users/5f69fbb373274f99ad97bcb2bd3bb5ba/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.496851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc05deff4104ec4a734b4a63b3bb3cd, user_id=5f69fbb373274f99ad97bcb2bd3bb5ba, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.499580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.523091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 980/1886] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:45 2022] PUT /identity/v3/projects/9cc05deff4104ec4a734b4a63b3bb3cd/users/5f69fbb373274f99ad97bcb2bd3bb5ba/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:45.523091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.523485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff31243fb74b4a828fd9785825928d13', 'request_id': 'req-2e5d550d-f8f7-4f79-a66d-05162bf2c963'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:45.533749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff31243fb74b4a828fd9785825928d13', 'request_id': 'req-2e5d550d-f8f7-4f79-a66d-05162bf2c963'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:45.558289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] The token cache is being invalidate because project ff31243fb74b4a828fd9785825928d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:45.558289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:45.558289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2e5d550d-f8f7-4f79-a66d-05162bf2c963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:45.560332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 907/1887] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:45 2022] DELETE /identity/v3/projects/ff31243fb74b4a828fd9785825928d13 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:45.562443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.562806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.563149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.602608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] MFA Rules not processed for user `5f69fbb373274f99ad97bcb2bd3bb5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:45.603852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:45.640929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d641233-5d1c-452d-8dc7-aba7a8331600 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.645955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420a44-aa44-457d-91e4-238ebdd714c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.646693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420a44-aa44-457d-91e4-238ebdd714c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.647031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420a44-aa44-457d-91e4-238ebdd714c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.647306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420a44-aa44-457d-91e4-238ebdd714c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.648226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420a44-aa44-457d-91e4-238ebdd714c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.649975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420a44-aa44-457d-91e4-238ebdd714c7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.662234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 981/1888] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:45.667541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.667541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.667541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.687125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:45.688376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:45.696410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 908/1889] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:45.699640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.699640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:45.699839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 982/1890] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:45.709913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.711407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:45.716283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af621c5c-9709-4794-8388-d6e3abd4ca92 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.723045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49cdf4-e878-4d30-b7b9-dd627977a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.724421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49cdf4-e878-4d30-b7b9-dd627977a07e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.725065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49cdf4-e878-4d30-b7b9-dd627977a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.725570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49cdf4-e878-4d30-b7b9-dd627977a07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.726342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49cdf4-e878-4d30-b7b9-dd627977a07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.728176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49cdf4-e878-4d30-b7b9-dd627977a07e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.743479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 909/1891] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:45.744972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.745272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.745558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.768958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:45.770249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:45.780945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 910/1892] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:45.780945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.786676 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85d6b-e149-40ac-8381-e324f309fdf1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.790696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.791385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.791656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.791945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.792096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994460b-6c73-49d8-bbf0-da13a85b4d25 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.797088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414536a-3be4-42cc-a9e2-fa7b9f2ac925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.797780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414536a-3be4-42cc-a9e2-fa7b9f2ac925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.798427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414536a-3be4-42cc-a9e2-fa7b9f2ac925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.798544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414536a-3be4-42cc-a9e2-fa7b9f2ac925 admin admin] PATH_INFO: `/v3/projects/e0b9546698e44805827df1cab499583c/users/fe22c2c7bf254ae9a9bb9d6746192874/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.803107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.804254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.815610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 983/1893] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:45.816504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.817445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414536a-3be4-42cc-a9e2-fa7b9f2ac925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b9546698e44805827df1cab499583c, user_id=fe22c2c7bf254ae9a9bb9d6746192874, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.820936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414536a-3be4-42cc-a9e2-fa7b9f2ac925 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.830770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721d30-8bdd-4525-b478-7856542972a5 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.836303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.836962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.837239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.837590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.839748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:45.840233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.841934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.859205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 984/1894] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:45.863437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:45.874800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57cc5-9729-4f40-90e8-db6652fd4927 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:45.879598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:45.885473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.885473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.885473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:45.885473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:45.885473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:45.966722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 911/1895] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:45 2022] PUT /identity/v3/projects/e0b9546698e44805827df1cab499583c/users/fe22c2c7bf254ae9a9bb9d6746192874/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:45.977858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:45.978145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:45.978573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.008261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] MFA Rules not processed for user `fe22c2c7bf254ae9a9bb9d6746192874`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:46.009751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:46.055828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 985/1896] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:45 2022] POST /identity/v3/projects => generated 407 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:46.057870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:46.100988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 912/1897] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:46.113892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:46.143418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475fbc-751b-4aa4-a715-307f7fd39cc3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:46.150357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:46.153105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.153105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.153105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.153105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:46.154643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:46.179876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402891d-e98a-44e6-8b23-d20c2c89f63a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:46.209804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:46.244765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:46.245860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.246149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.246428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.326659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:46.328310 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:46.339657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 913/1898] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:46.344637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 986/1899] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:46 2022] POST /identity/v3/users => generated 304 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:46.348747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:46.361398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fcd8f-eb34-4777-91e1-68d381213987 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:46.365949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:46.366752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.367032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.367311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.368079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:46.370191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:46.389542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 914/1900] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:46.399594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:46.416018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327b822-9946-4359-839a-af49553a8b40 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:46.423756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7891d0-ead3-436a-b66a-4ec6924d243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:46.425153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7891d0-ead3-436a-b66a-4ec6924d243e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.425768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7891d0-ead3-436a-b66a-4ec6924d243e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.426199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7891d0-ead3-436a-b66a-4ec6924d243e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.427242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7891d0-ead3-436a-b66a-4ec6924d243e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:46.429837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7891d0-ead3-436a-b66a-4ec6924d243e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:46.442267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 987/1901] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:46.447079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:46.461372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f7df0-d153-420f-9b83-2f9da91f6ed5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:46.468299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:46.469206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.471359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.471359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] PATH_INFO: `/v3/projects/3acaa3123d1d4859bf9e5b2cfd03aaa9/users/b5294c90131e4ccf819d10cb8f726af9/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.485859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acaa3123d1d4859bf9e5b2cfd03aaa9, user_id=b5294c90131e4ccf819d10cb8f726af9, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:46.488644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:46.583086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 915/1902] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:46 2022] PUT /identity/v3/projects/3acaa3123d1d4859bf9e5b2cfd03aaa9/users/b5294c90131e4ccf819d10cb8f726af9/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:46.594360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.594925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.595062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.639134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] MFA Rules not processed for user `b5294c90131e4ccf819d10cb8f726af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:46.640743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:46.727039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 988/1903] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:46.731806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:46.825978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:46.878572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d85b-2da8-42b4-a6ec-89377adc02d5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:46.884793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:46.886694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:46.886694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:46.886694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:46.888065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:46.890379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:47.024027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 916/1904] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:46 2022] POST /identity/v3/projects => generated 407 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:47.028290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:47.046427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4debf30-b306-4275-8529-19ff7a541c9c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:47.143840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:47.144542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:47.145041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:47.145389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:47.146378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:47.149840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:47.294858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 989/1905] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:47 2022] POST /identity/v3/users => generated 310 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:47.296152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:47.330634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b621af-1a02-4be0-bc22-72d8b375478f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:47.342922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:47.344250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:47.344627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:47.344934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:47.345614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:47.349131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:47.362449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 917/1906] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:47.366560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:47.379380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac6198-16b6-477b-8994-e4f0268beaab admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:47.399077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:47.404586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:47.404586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:47.404586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] PATH_INFO: `/v3/projects/3cc7adba07c640c1ba0c3b5574b10658/users/a9de570190294abba32c32034617ec0a/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:47.420532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc7adba07c640c1ba0c3b5574b10658, user_id=a9de570190294abba32c32034617ec0a, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:47.423735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:47.561064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 990/1907] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:47 2022] PUT /identity/v3/projects/3cc7adba07c640c1ba0c3b5574b10658/users/a9de570190294abba32c32034617ec0a/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:47.564852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:47.579589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d474-5e35-4b81-b31d-8229c9326055 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:47.694954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387d0c-c44b-4100-95c4-cb82a89d7ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:47.696099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387d0c-c44b-4100-95c4-cb82a89d7ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:47.696625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387d0c-c44b-4100-95c4-cb82a89d7ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:47.697321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387d0c-c44b-4100-95c4-cb82a89d7ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:47.702176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66387d0c-c44b-4100-95c4-cb82a89d7ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:47.702176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66387d0c-c44b-4100-95c4-cb82a89d7ca9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:47.714375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 918/1908] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:47.718527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:47.735716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc944f-5ab6-4b1b-83e2-c11c342d97d3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:47.748990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:47.749995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:47.750886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:47.751519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] PATH_INFO: `/v3/projects/3cc7adba07c640c1ba0c3b5574b10658/users/a9de570190294abba32c32034617ec0a/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:47.754855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc7adba07c640c1ba0c3b5574b10658, user_id=a9de570190294abba32c32034617ec0a, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:47.761656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:47.785682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 991/1909] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:47 2022] PUT /identity/v3/projects/3cc7adba07c640c1ba0c3b5574b10658/users/a9de570190294abba32c32034617ec0a/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:47.799122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:47.799726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:47.800138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:47.814795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:47.836692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] MFA Rules not processed for user `a9de570190294abba32c32034617ec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:47.838204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:47.915322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 919/1910] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:47.931666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:48.020659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4cb12-2b6f-4dc9-a810-b8db9f05c73f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:48.031252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:48.031882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:48.032158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:48.033065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:48.057502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:48.062570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:48.091705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 992/1911] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:48.758041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:48.771589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850555b-65ab-4b07-a117-4aec258c2b46 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:48.777051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a3e2-fdf6-4586-9418-3ec86541593c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:48.778098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a3e2-fdf6-4586-9418-3ec86541593c service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:48.778398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a3e2-fdf6-4586-9418-3ec86541593c service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:48.778826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a3e2-fdf6-4586-9418-3ec86541593c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:48.875501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a3e2-fdf6-4586-9418-3ec86541593c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:48.877458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a3e2-fdf6-4586-9418-3ec86541593c service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:48.901622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 920/1912] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:49.890689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:50.942770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:50.944907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:51.014735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbde3da-55bd-48af-8f28-b558859c4f80 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:51.019351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:51.019992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:51.023118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:51.023118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] PATH_INFO: `/v3/users/2963eaad0a1a4d7890719584d706bfaf` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:51.023118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2963eaad0a1a4d7890719584d706bfaf)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:51.025190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:51.316797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2963eaad0a1a4d7890719584d706bfaf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:51.329324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2963eaad0a1a4d7890719584d706bfaf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:51.336525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2963eaad0a1a4d7890719584d706bfaf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:51.337297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2963eaad0a1a4d7890719584d706bfaf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:51.480134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2963eaad0a1a4d7890719584d706bfaf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:51.487340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 993/1913] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:50 2022] DELETE /identity/v3/users/2963eaad0a1a4d7890719584d706bfaf => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:51.493507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:51.494180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:51.494675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:51.526067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:51.528157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:51.603525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 921/1914] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:51.613507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:51.614940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:51.675161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609dd4-b43f-4856-9dfb-ab62f3dae17c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:51.679553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:51.680207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:51.680490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:51.680751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:51.690022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:51.691388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:51.701384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 994/1915] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:52.284258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:52.285790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:52.299380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e967be1-328f-4f19-bc7b-5c5afd8ba6d5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:52.319228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:52.319959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:52.319959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:52.320162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] PATH_INFO: `/v3/projects/16d7f27fccc04a4caed936b83780f0bd` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:52.321321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d7f27fccc04a4caed936b83780f0bd)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:52.323219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:52.515331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d7f27fccc04a4caed936b83780f0bd', 'request_id': 'req-10c0906b-0cc7-4058-a962-f742eef45d3c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:52.651482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:52.657913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d7f27fccc04a4caed936b83780f0bd', 'request_id': 'req-10c0906b-0cc7-4058-a962-f742eef45d3c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:52.664976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d7f27fccc04a4caed936b83780f0bd', 'request_id': 'req-10c0906b-0cc7-4058-a962-f742eef45d3c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:52.673827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] The token cache is being invalidate because project 16d7f27fccc04a4caed936b83780f0bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:52.674121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:52.674824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:52.676409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 922/1916] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:52 2022] DELETE /identity/v3/projects/16d7f27fccc04a4caed936b83780f0bd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:52.681351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:52.694364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb982-039c-4471-8d14-1d9c571eb385 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:52.758994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:52.759786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:52.760083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:52.760362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] PATH_INFO: `/v3/users/5f69fbb373274f99ad97bcb2bd3bb5ba` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:52.761764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f69fbb373274f99ad97bcb2bd3bb5ba)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:52.763726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:53.046420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f69fbb373274f99ad97bcb2bd3bb5ba'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:53.059390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f69fbb373274f99ad97bcb2bd3bb5ba'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:53.066695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f69fbb373274f99ad97bcb2bd3bb5ba'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:53.067718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f69fbb373274f99ad97bcb2bd3bb5ba'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:53.270771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e54eb7be-1f83-4402-8c6f-29efbb825c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f69fbb373274f99ad97bcb2bd3bb5ba'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:53.278997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 995/1917] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:52 2022] DELETE /identity/v3/users/5f69fbb373274f99ad97bcb2bd3bb5ba => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:53.850577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:53.852097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:53.866804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0906b-0cc7-4058-a962-f742eef45d3c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:53.926094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:53.927300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:53.927611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:53.927855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] PATH_INFO: `/v3/projects/9cc05deff4104ec4a734b4a63b3bb3cd` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:53.929068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc05deff4104ec4a734b4a63b3bb3cd)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:53.931013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:54.132519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc05deff4104ec4a734b4a63b3bb3cd', 'request_id': 'req-bc443658-9918-45b1-9334-eb6f136f68e3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:54.291384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc05deff4104ec4a734b4a63b3bb3cd', 'request_id': 'req-bc443658-9918-45b1-9334-eb6f136f68e3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:54.302781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc05deff4104ec4a734b4a63b3bb3cd', 'request_id': 'req-bc443658-9918-45b1-9334-eb6f136f68e3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:54.317382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] The token cache is being invalidate because project 9cc05deff4104ec4a734b4a63b3bb3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:54.317679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:54.318373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bc443658-9918-45b1-9334-eb6f136f68e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:54.323358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 923/1918] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:53 2022] DELETE /identity/v3/projects/9cc05deff4104ec4a734b4a63b3bb3cd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:54.328015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:54.328511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:54.328687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:54.349733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:54.351460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:54.435833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 996/1919] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:54.444443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:54.444770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:54.445080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:54.467932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:54.469205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:54.479067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 924/1920] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:54.483836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:54.495475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c60ab-f734-4c80-adcf-a75274506ec7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:54.501302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:54.501930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:54.502216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:54.502525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:54.503653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:54.503970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:54.505725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:54.519264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 997/1921] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:54.524476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:54.533724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f451c-279c-4b7f-bef7-c58e0258a5c3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:54.539331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:54.539956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:54.540407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:54.540753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:54.548940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:54.548940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:54.862653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 925/1922] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:54 2022] POST /identity/v3/projects => generated 383 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:54.864719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:54.875517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f6eb5-a025-4124-8571-5b7b11c79957 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:54.934272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:54.934954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:54.935227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:54.935523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:54.936169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:54.938155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:55.102123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 998/1923] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:54 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:55.106216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:55.135002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16663f75-a052-48c5-ae10-e057b1d923fb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:55.140276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:55.141203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:55.141490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:55.141767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:55.142431 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:55.144125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:55.155549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 926/1924] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:55.159896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:55.171347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7b8e-1cb4-462e-b14e-2df916ecd86c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:55.176602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c7a14-6cf9-44ef-9cf4-31ce250f5746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:55.177348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7a14-6cf9-44ef-9cf4-31ce250f5746 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:55.177732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7a14-6cf9-44ef-9cf4-31ce250f5746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:55.178639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7a14-6cf9-44ef-9cf4-31ce250f5746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:55.179308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7a14-6cf9-44ef-9cf4-31ce250f5746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:55.181283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7a14-6cf9-44ef-9cf4-31ce250f5746 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:55.192659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 999/1925] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:55.197730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:55.208208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b8bd-a03a-4579-a946-71e09dbed06a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:55.213102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:55.213776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:55.214064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:55.214342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] PATH_INFO: `/v3/projects/1c36f40764cb4cbfb70b10ca12b13536/users/1e0aa1aec2924f08bad8f32cf66b587c/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:55.238005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c36f40764cb4cbfb70b10ca12b13536, user_id=1e0aa1aec2924f08bad8f32cf66b587c, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:55.241388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:55.363254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:55.420738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 927/1926] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:55 2022] PUT /identity/v3/projects/1c36f40764cb4cbfb70b10ca12b13536/users/1e0aa1aec2924f08bad8f32cf66b587c/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:55.430149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:55.430463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:55.430743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:55.461583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] MFA Rules not processed for user `1e0aa1aec2924f08bad8f32cf66b587c`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:55.462848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:55.546839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1000/1927] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:55.548226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:55.625117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d33cf-3eb5-4cf3-a324-9048169e5ac6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:55.631362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:55.632000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:55.632440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:55.632722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:55.633409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:55.635398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:55.783969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 928/1928] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:55 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:55.788898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:55.799607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b5080-3a9f-41b6-b5ef-e1437b745b89 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:55.859778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:55.860410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:55.860700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:55.861095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:55.861732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:55.863771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.001046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1001/1929] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:55 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:56.004919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.027097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941be2-ab82-460f-833c-4705b1edb366 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.033271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.033911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.034498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.034722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.035392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.037373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.049456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 929/1930] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:56.055747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.067660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39538-32b7-442e-b2eb-ee0f60f2f297 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.076007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.076881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.077160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.077437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] PATH_INFO: `/v3/projects/b9e76bd43f4046f7a400ad238fd1e030/users/6c4afb0540aa44fda6de16f8a7817f5e/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.111728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e76bd43f4046f7a400ad238fd1e030, user_id=6c4afb0540aa44fda6de16f8a7817f5e, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.115688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.116588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.119644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:56.133057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff93379-1295-4816-89cd-00aaf01e0fb7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.137816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.138464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.138746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.139023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] PATH_INFO: `/v3/users/fe22c2c7bf254ae9a9bb9d6746192874` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.140307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe22c2c7bf254ae9a9bb9d6746192874)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.142377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.218158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1002/1931] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:56 2022] PUT /identity/v3/projects/b9e76bd43f4046f7a400ad238fd1e030/users/6c4afb0540aa44fda6de16f8a7817f5e/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:56.222207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.288538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567c2c1-f288-4708-957f-83eea30eb276 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.294309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.297221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.297736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.301256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.303495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.305739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.316944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1003/1932] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:56.322732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.331678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641476d3-bf3c-4984-8e7c-28ffd684f3f4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.336610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14195cae-723c-4a64-92a3-c06e354160d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.337303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14195cae-723c-4a64-92a3-c06e354160d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.337612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14195cae-723c-4a64-92a3-c06e354160d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.337916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14195cae-723c-4a64-92a3-c06e354160d5 admin admin] PATH_INFO: `/v3/projects/b9e76bd43f4046f7a400ad238fd1e030/users/6c4afb0540aa44fda6de16f8a7817f5e/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.339878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14195cae-723c-4a64-92a3-c06e354160d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e76bd43f4046f7a400ad238fd1e030, user_id=6c4afb0540aa44fda6de16f8a7817f5e, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.342584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14195cae-723c-4a64-92a3-c06e354160d5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.353926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1004/1933] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:56 2022] PUT /identity/v3/projects/b9e76bd43f4046f7a400ad238fd1e030/users/6c4afb0540aa44fda6de16f8a7817f5e/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:56.363758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.364454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.364454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.371747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe22c2c7bf254ae9a9bb9d6746192874'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:56.372539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe22c2c7bf254ae9a9bb9d6746192874'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:56.387468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe22c2c7bf254ae9a9bb9d6746192874'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:56.396971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe22c2c7bf254ae9a9bb9d6746192874'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:56.396971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0a7e0845-a875-45db-93d1-f5f76ad33e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe22c2c7bf254ae9a9bb9d6746192874'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:56.407201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] MFA Rules not processed for user `6c4afb0540aa44fda6de16f8a7817f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:56.408296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:56.502443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1005/1934] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:56.510953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.514754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:56.585984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9aab-db44-48cf-a4d8-39f8c01158f2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.591760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 930/1935] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:56 2022] DELETE /identity/v3/users/fe22c2c7bf254ae9a9bb9d6746192874 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:56.592915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.593723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.594020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.594167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.594421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.594885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.595502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.596691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:56.655262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:56.658975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:56.679888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.681392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.692195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1006/1936] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:56.752621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 931/1937] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:56.763000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:56.765102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:56.847633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bf26-55fb-42d1-978a-3a3071377f19 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:56.920607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f74241-e6ef-486f-98e0-19c61f288c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:56.921569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f74241-e6ef-486f-98e0-19c61f288c93 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:56.922202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f74241-e6ef-486f-98e0-19c61f288c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:56.922489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f74241-e6ef-486f-98e0-19c61f288c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:56.935851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f74241-e6ef-486f-98e0-19c61f288c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:56.937436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f74241-e6ef-486f-98e0-19c61f288c93 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:56.952037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1007/1938] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:57.023452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:57.665265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:57.671211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:57.700527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02e76-5f67-49a3-b039-d1b0b9d72311 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:57.705441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:57.706138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:57.706393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:57.709108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] PATH_INFO: `/v3/projects/e0b9546698e44805827df1cab499583c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:57.711544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b9546698e44805827df1cab499583c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:57.722504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:57.946746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b9546698e44805827df1cab499583c', 'request_id': 'req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.071622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b9546698e44805827df1cab499583c', 'request_id': 'req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.082765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b9546698e44805827df1cab499583c', 'request_id': 'req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.094613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] The token cache is being invalidate because project e0b9546698e44805827df1cab499583c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:58.094911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.095585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-27257dc6-86ae-4819-ab8a-2753ceaf7ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.097143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 932/1939] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:57 2022] DELETE /identity/v3/projects/e0b9546698e44805827df1cab499583c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:58.102946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.103500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.104067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.126434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:58.127799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:58.217031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1008/1940] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:58.227369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.236447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.236447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.252348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:58.254014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:58.264762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 933/1941] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:58.274142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.284864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f372-ce18-4e92-81dd-4c8bb172c63a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.290498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.291124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.291563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.291935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.292679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:58.293096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.294804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.324843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1009/1942] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:32:58.327848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.339700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69143e2a-fa51-4191-8df9-c51d60542b83 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.346088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.346738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.347106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.347447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.348995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.351757 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.518968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 934/1943] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:58 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:58.524344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.534560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0bd2d-0d8f-4ba0-9532-062ccaf49064 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.591798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.593538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:58.621967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.622613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.622888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.623165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.628401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.630787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.697730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6f11-62ac-426a-b9bb-708f41abdd8f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.702622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.703274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.703559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.703860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] PATH_INFO: `/v3/users/b5294c90131e4ccf819d10cb8f726af9` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.709602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5294c90131e4ccf819d10cb8f726af9)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.709602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.740259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1010/1944] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:58 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:32:58.744796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.761710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075535da-a4e3-4563-b51c-0c6117843393 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.774275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.775221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.775509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.775888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.776662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.778554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.792849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1011/1945] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:58.794512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.805695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56a074-12f4-4cef-ba4e-6ec9ddfacde2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.810421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.811214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.811496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.811774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.812418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.814057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.827296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1012/1946] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:32:58.828286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:58.839723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a709-8d8d-41a9-b83d-04343ec321bc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:58.844365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eede1-8400-4b9c-805b-1273b2907558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:58.845028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eede1-8400-4b9c-805b-1273b2907558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.845317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eede1-8400-4b9c-805b-1273b2907558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.845598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eede1-8400-4b9c-805b-1273b2907558 admin admin] PATH_INFO: `/v3/projects/da044f6778594166a30d2baaee72f93c/users/9fe79a1b63b6450f940956a7723b39ed/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.861944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eede1-8400-4b9c-805b-1273b2907558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da044f6778594166a30d2baaee72f93c, user_id=9fe79a1b63b6450f940956a7723b39ed, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:58.864767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eede1-8400-4b9c-805b-1273b2907558 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:58.917009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5294c90131e4ccf819d10cb8f726af9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.917686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5294c90131e4ccf819d10cb8f726af9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.937551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:58.937741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5294c90131e4ccf819d10cb8f726af9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.937941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1013/1947] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:58 2022] PUT /identity/v3/projects/da044f6778594166a30d2baaee72f93c/users/9fe79a1b63b6450f940956a7723b39ed/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:58.941671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5294c90131e4ccf819d10cb8f726af9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.942494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b4d89550-f6e4-45e3-b57f-ea2dfee67aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5294c90131e4ccf819d10cb8f726af9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:58.948689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3c820-27da-49d9-8eb4-f55c113d6a6f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:58.949152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3c820-27da-49d9-8eb4-f55c113d6a6f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:58.949524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3c820-27da-49d9-8eb4-f55c113d6a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:58.979906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-79e3c820-27da-49d9-8eb4-f55c113d6a6f None None] MFA Rules not processed for user `9fe79a1b63b6450f940956a7723b39ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:58.981105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-79e3c820-27da-49d9-8eb4-f55c113d6a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.038245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 935/1948] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:58 2022] DELETE /identity/v3/users/b5294c90131e4ccf819d10cb8f726af9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:32:59.044667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc1d9-c6cb-44d4-b499-935fb1eab950 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.045719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc1d9-c6cb-44d4-b499-935fb1eab950 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.046206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc1d9-c6cb-44d4-b499-935fb1eab950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.072978 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1014/1949] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:59.073108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-782fc1d9-c6cb-44d4-b499-935fb1eab950 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:59.073108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-782fc1d9-c6cb-44d4-b499-935fb1eab950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.075387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbcbe1-33e8-4c97-9c78-1c7fa50a9034 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.075962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbcbe1-33e8-4c97-9c78-1c7fa50a9034 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.076388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbcbe1-33e8-4c97-9c78-1c7fa50a9034 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.077969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1015/1950] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:32:59.085316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbcbe1-33e8-4c97-9c78-1c7fa50a9034 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:59.087832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aafbcbe1-33e8-4c97-9c78-1c7fa50a9034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.148486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 936/1951] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:59.148486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.148486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.148486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.168981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbcbe1-33e8-4c97-9c78-1c7fa50a9034 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:59.171901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:59.173034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637484d-e7ab-4d53-9204-2d5c0c60ff8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:59.173183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.173649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637484d-e7ab-4d53-9204-2d5c0c60ff8d service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.174000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637484d-e7ab-4d53-9204-2d5c0c60ff8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.174204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637484d-e7ab-4d53-9204-2d5c0c60ff8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.240092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 937/1952] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:59.240911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637484d-e7ab-4d53-9204-2d5c0c60ff8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:59.242054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:59.243141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637484d-e7ab-4d53-9204-2d5c0c60ff8d service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:59.243793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.253426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1016/1953] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:59.254911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa62d70-bd86-40d6-adc0-42288f984898 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.255210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa62d70-bd86-40d6-adc0-42288f984898 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.255493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa62d70-bd86-40d6-adc0-42288f984898 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.257475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1017/1954] 10.222.0.76 () {54 vars in 961 bytes} [Wed Aug 31 19:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:59.262517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.262943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.263457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.305122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:59.306615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.310557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcbc61-e78d-49dc-80d9-443c567006e7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:59.315208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:59.331548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.331548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.331548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.331970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1018/1955] 10.222.0.76 () {58 vars in 1058 bytes} [Wed Aug 31 19:32:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:32:59.331970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:59.331970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.332296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:59.332296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:59.338298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f47e2-a5f0-4ad9-883f-de8f5a29a9eb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:59.338971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 938/1956] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:59.339624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:59.350932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:59.351337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4944595-db58-4e8c-a4a8-4b2f8a197027 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:59.351588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.351880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.352355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] PATH_INFO: `/v3/users/c80a3e49a7cc420ab6709b0f2c54c079` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.356952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80a3e49a7cc420ab6709b0f2c54c079)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:59.356952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:59.379221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:59.382074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.385682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.385682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.394613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:59.397321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:59.410390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 939/1957] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:59.674531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80a3e49a7cc420ab6709b0f2c54c079'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:59.689490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80a3e49a7cc420ab6709b0f2c54c079'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:59.698206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80a3e49a7cc420ab6709b0f2c54c079'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:59.699047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80a3e49a7cc420ab6709b0f2c54c079'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:59.795493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80a3e49a7cc420ab6709b0f2c54c079'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:59.810823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:59.811343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1019/1958] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:59 2022] DELETE /identity/v3/users/c80a3e49a7cc420ab6709b0f2c54c079 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:59.811421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:59.825805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de42f1-435c-4d7b-add6-b08156fff353 service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:59.905469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:59.905469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:59.905469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:59.905469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] PATH_INFO: `/v3/projects/3acaa3123d1d4859bf9e5b2cfd03aaa9` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:59.906471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acaa3123d1d4859bf9e5b2cfd03aaa9)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:59.906471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:59.963247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:00.035480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acaa3123d1d4859bf9e5b2cfd03aaa9', 'request_id': 'req-9a56a15a-813e-4b87-a67e-87b4488b9c72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.129610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acaa3123d1d4859bf9e5b2cfd03aaa9', 'request_id': 'req-9a56a15a-813e-4b87-a67e-87b4488b9c72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.130169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:00.133138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:00.140287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acaa3123d1d4859bf9e5b2cfd03aaa9', 'request_id': 'req-9a56a15a-813e-4b87-a67e-87b4488b9c72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.148159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae72b-63a0-46d6-8624-41283361c1cf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:00.156584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] The token cache is being invalidate because project 3acaa3123d1d4859bf9e5b2cfd03aaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:00.156921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.160352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.168665 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 940/1959] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:59 2022] DELETE /identity/v3/projects/3acaa3123d1d4859bf9e5b2cfd03aaa9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:00.169952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:00.173155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:00.225765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:00.226519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:00.226797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:00.227067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] PATH_INFO: `/v3/projects/e005639c51ec4228a21a3a2a3fb56519` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:00.228341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e005639c51ec4228a21a3a2a3fb56519)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:00.230528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:00.250081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56a15a-813e-4b87-a67e-87b4488b9c72 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:00.256005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:00.256965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:00.257300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:00.257610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] PATH_INFO: `/v3/users/a9de570190294abba32c32034617ec0a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:00.258806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9de570190294abba32c32034617ec0a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:00.261162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:00.599329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:00.621393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e005639c51ec4228a21a3a2a3fb56519', 'request_id': 'req-c302e133-5127-4194-a8f0-b61634316fa6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.621597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9de570190294abba32c32034617ec0a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.621597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9de570190294abba32c32034617ec0a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.625307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9de570190294abba32c32034617ec0a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.633690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9de570190294abba32c32034617ec0a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.634425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5f41c779-33dd-4486-8d39-e3e02db8b75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9de570190294abba32c32034617ec0a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.750960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e005639c51ec4228a21a3a2a3fb56519', 'request_id': 'req-c302e133-5127-4194-a8f0-b61634316fa6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.755581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e005639c51ec4228a21a3a2a3fb56519', 'request_id': 'req-c302e133-5127-4194-a8f0-b61634316fa6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.767200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] The token cache is being invalidate because project e005639c51ec4228a21a3a2a3fb56519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:00.767530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.768286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c302e133-5127-4194-a8f0-b61634316fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:00.769971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1020/1960] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:00 2022] DELETE /identity/v3/projects/e005639c51ec4228a21a3a2a3fb56519 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:00.788878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:00.788878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:00.788878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:00.814523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:00.815760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:00.838679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 941/1961] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:00 2022] DELETE /identity/v3/users/a9de570190294abba32c32034617ec0a => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:00.901517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1021/1962] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:00.912283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:00.913325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:00.913865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:00.936383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:00.937687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:01.005294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 942/1963] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:01.010210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.020222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2cca4-67b0-42d8-ad8e-8274fb7d47d3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.026245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.035152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.035152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.035152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.035152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:01.035152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.035152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.043628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1022/1964] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:33:01.049966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.063720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b5b43-eec0-43ae-a6ac-1d84a9abcd2a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.069967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.070689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.071067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.071408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.072071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.075521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.197060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 943/1965] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:01 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:01.201237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.215712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e5ff-706f-4cb9-9806-dd2eb16d6af5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.276535 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.277239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.277445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.277721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.278357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.280281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.315704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.317618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:01.331029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14298d75-332c-4fc1-a098-91c3b59629b2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.336481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.337169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.337452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.338014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] PATH_INFO: `/v3/projects/3cc7adba07c640c1ba0c3b5574b10658` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.339217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc7adba07c640c1ba0c3b5574b10658)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.341178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.443860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1023/1966] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:01 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:33:01.448385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.459798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4a268-a7a3-4f56-8d1c-1986b09a6018 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.464892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.465540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.465824 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.466099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.466757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.468356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.482594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1024/1967] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:01.487315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.491039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc7adba07c640c1ba0c3b5574b10658', 'request_id': 'req-4d1f03fa-e2f1-459b-b784-18859271bd93'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:01.503256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def303-fe45-4d95-8561-ba87959a5564 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.574770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.575527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.575807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.580085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.580085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.580085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.589391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1025/1968] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:01.593566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.604458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731410d7-d858-44b8-b4ce-190cdaca2b11 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.609742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc0e84-39fe-4a8a-a40c-8108f2a4a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.610502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0e84-39fe-4a8a-a40c-8108f2a4a637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.610789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0e84-39fe-4a8a-a40c-8108f2a4a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.611066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0e84-39fe-4a8a-a40c-8108f2a4a637 admin admin] PATH_INFO: `/v3/projects/8c4964b0e7f84b069a048bf1b1ac0cc7/users/42e3c693cc9f435899ff83565a396f8d/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.626429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc0e84-39fe-4a8a-a40c-8108f2a4a637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4964b0e7f84b069a048bf1b1ac0cc7, user_id=42e3c693cc9f435899ff83565a396f8d, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.629108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc0e84-39fe-4a8a-a40c-8108f2a4a637 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.690723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc7adba07c640c1ba0c3b5574b10658', 'request_id': 'req-4d1f03fa-e2f1-459b-b784-18859271bd93'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:01.697592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc7adba07c640c1ba0c3b5574b10658', 'request_id': 'req-4d1f03fa-e2f1-459b-b784-18859271bd93'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:01.708030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] The token cache is being invalidate because project 3cc7adba07c640c1ba0c3b5574b10658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:01.708342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:01.709595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d1f03fa-e2f1-459b-b784-18859271bd93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:01.711104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 944/1969] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:01 2022] DELETE /identity/v3/projects/3cc7adba07c640c1ba0c3b5574b10658 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:01.715908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850b17-30b7-4629-b050-1bc26b0cc7fd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.716197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850b17-30b7-4629-b050-1bc26b0cc7fd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.716479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850b17-30b7-4629-b050-1bc26b0cc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.736486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1026/1970] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:01 2022] PUT /identity/v3/projects/8c4964b0e7f84b069a048bf1b1ac0cc7/users/42e3c693cc9f435899ff83565a396f8d/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:01.737741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-36850b17-30b7-4629-b050-1bc26b0cc7fd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:01.738964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-36850b17-30b7-4629-b050-1bc26b0cc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:01.746747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da561-609d-472e-a26e-d8c9029f562c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.747041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da561-609d-472e-a26e-d8c9029f562c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.747322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da561-609d-472e-a26e-d8c9029f562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.775971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-743da561-609d-472e-a26e-d8c9029f562c None None] MFA Rules not processed for user `42e3c693cc9f435899ff83565a396f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:01.777187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-743da561-609d-472e-a26e-d8c9029f562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:01.799173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 945/1971] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:01.807047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.807359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.807751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.828791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:01.830879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:01.846905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 946/1972] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:01.851323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.863448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50131df5-41ac-4979-8282-52ede51ddd65 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.867366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1027/1973] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:01.870353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.870980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.871263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.871540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.874988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:01.875404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.877296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.882627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da561-609d-472e-a26e-d8c9029f562c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.884269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-743da561-609d-472e-a26e-d8c9029f562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:01.890195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 947/1974] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:33:01.894602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.905257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16814f9-f7f1-45f7-94e7-bcf7da81cc93 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.910032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.910626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.910909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.911238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.911874 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.913930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.943891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da561-609d-472e-a26e-d8c9029f562c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:01.947702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:01.948305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:01.948586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:01.948982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:01.957419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:01.958925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:01.968193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1028/1975] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:01.987432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:01.988906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:02.002881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a23aa-8084-4df0-bc89-0501bba4c0e3 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.008284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.008949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.009236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.009513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] PATH_INFO: `/v3/users/42e3c693cc9f435899ff83565a396f8d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.010663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e3c693cc9f435899ff83565a396f8d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.012620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.055135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 948/1976] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:01 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:33:02.059336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:02.124854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c69d-cd87-4afc-9b38-688f3970bdf0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.136971 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.137605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.137889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.138164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.138949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.141963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.385451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 949/1977] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:02 2022] POST /identity/v3/users => generated 289 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:33:02.389183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:02.394862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e3c693cc9f435899ff83565a396f8d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:02.405699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729154e0-dd7e-4aec-b98c-80ac7e07e68c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.410976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.411722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.411869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e3c693cc9f435899ff83565a396f8d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:02.412162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.412461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.413177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.419279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.419642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e3c693cc9f435899ff83565a396f8d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:02.420204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e3c693cc9f435899ff83565a396f8d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:02.432177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 950/1978] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:02.433292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:02.443284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645472-80d4-48dc-8bfa-313c8c8cbc8e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.447990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.448590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.448946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.449290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.449931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.451547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.463529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 951/1979] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:02.467579 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:02.478560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8187b-930d-4fe4-a38d-c16aeb917f6e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.488235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6d50-04ec-4d62-864e-53953688d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.488235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6d50-04ec-4d62-864e-53953688d46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.488235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6d50-04ec-4d62-864e-53953688d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.488235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6d50-04ec-4d62-864e-53953688d46c admin admin] PATH_INFO: `/v3/projects/285e2bb041bb4b42995c4c2d87951429/users/71416979ab694b1782e1b66af429a6e2/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.499980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c6d50-04ec-4d62-864e-53953688d46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=285e2bb041bb4b42995c4c2d87951429, user_id=71416979ab694b1782e1b66af429a6e2, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.502774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c6d50-04ec-4d62-864e-53953688d46c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.536306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d75dd2af-bbba-4083-ada2-318eba4694d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e3c693cc9f435899ff83565a396f8d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:02.544952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1029/1980] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:01 2022] DELETE /identity/v3/users/42e3c693cc9f435899ff83565a396f8d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:02.548961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.549269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.549559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.570653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:02.571835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:02.638602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 952/1981] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:02 2022] PUT /identity/v3/projects/285e2bb041bb4b42995c4c2d87951429/users/71416979ab694b1782e1b66af429a6e2/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:02.643568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1030/1982] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:02.652510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.652906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.654264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.655707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:02.657224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:02.698794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] MFA Rules not processed for user `71416979ab694b1782e1b66af429a6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:02.701704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:02.723268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807347-1613-4c7a-9bbd-9eee1f8cc489 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.799660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.801044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.801965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.803749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.814895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 953/1983] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:02.833950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:02.836375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:02.893493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.894934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.901707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766e54-f945-4977-b0e6-e041395a7a7a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:02.906187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502077b4-edee-4f76-98f1-75cf6f4689ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:02.906886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502077b4-edee-4f76-98f1-75cf6f4689ac service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:02.907243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502077b4-edee-4f76-98f1-75cf6f4689ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:02.907594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502077b4-edee-4f76-98f1-75cf6f4689ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:02.910022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1031/1984] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:02.916720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502077b4-edee-4f76-98f1-75cf6f4689ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:02.918216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502077b4-edee-4f76-98f1-75cf6f4689ac service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:02.927647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 954/1985] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:03.051441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:03.391045 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:03.395751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:03.425359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd810-abc4-4945-bf38-0d1d1ab3191c service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:03.433198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:03.434635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:03.434921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:03.435205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] PATH_INFO: `/v3/projects/8c4964b0e7f84b069a048bf1b1ac0cc7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:03.436668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4964b0e7f84b069a048bf1b1ac0cc7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:03.438729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:03.533928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:03.595307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4964b0e7f84b069a048bf1b1ac0cc7', 'request_id': 'req-e9715191-1785-4c22-a75e-2b72acde1900'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:03.674186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4964b0e7f84b069a048bf1b1ac0cc7', 'request_id': 'req-e9715191-1785-4c22-a75e-2b72acde1900'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:03.684278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4964b0e7f84b069a048bf1b1ac0cc7', 'request_id': 'req-e9715191-1785-4c22-a75e-2b72acde1900'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:03.695727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] The token cache is being invalidate because project 8c4964b0e7f84b069a048bf1b1ac0cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:03.696026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:03.696691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e9715191-1785-4c22-a75e-2b72acde1900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:03.698221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1032/1986] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:03 2022] DELETE /identity/v3/projects/8c4964b0e7f84b069a048bf1b1ac0cc7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:03.703198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:03.703763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:03.703763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:03.724002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:03.725841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:03.799213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 955/1987] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:03.807506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:03.809404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:03.809404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:03.828171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:03.829438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:03.837722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1033/1988] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:03.850683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:03.852395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201ab71-993d-4701-a0d7-912b18286a13 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:03.857533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:03.858203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:03.858439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:03.858705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:03.859420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:03.859733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:03.861593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:03.876525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 956/1989] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:33:03.880713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:03.890723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a7a8-0dc5-44a7-9415-bca288680f9f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:03.895937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:03.896695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:03.897382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:03.897868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:03.898400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:03.900325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:04.065382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1034/1990] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:03 2022] POST /identity/v3/projects => generated 359 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:04.070592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:04.080509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7b3e0-7a16-433d-b285-a3ea528428a0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:04.141552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:04.142161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.147449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.147449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.147449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:04.147449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:04.276770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 957/1991] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:04 2022] POST /identity/v3/users => generated 280 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:04.283950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:04.295061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beff851-b44a-45da-9506-687807e54e26 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:04.300064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:04.300687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.301019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.301287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.301982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:04.304135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:04.314954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1035/1992] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:04.318959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:04.330961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f4ae-d535-4f36-a799-c8bbad894718 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:04.337767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561cb06-e576-4942-a256-7e913f5c19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:04.338410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561cb06-e576-4942-a256-7e913f5c19a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.338696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561cb06-e576-4942-a256-7e913f5c19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.338972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561cb06-e576-4942-a256-7e913f5c19a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.339631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561cb06-e576-4942-a256-7e913f5c19a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:04.341286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561cb06-e576-4942-a256-7e913f5c19a9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:04.356523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 958/1993] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:04.358972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:04.370091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba749-c449-4655-bc19-a2b67fb9088c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:04.375096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:04.375791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.376076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.376356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] PATH_INFO: `/v3/projects/62c3628e7c404903af3d0a1604b37479/users/6820e627fbc64ac0ba1317ae76c7b547/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.393192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c3628e7c404903af3d0a1604b37479, user_id=6820e627fbc64ac0ba1317ae76c7b547, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:04.395790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:04.520683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1036/1994] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:04 2022] PUT /identity/v3/projects/62c3628e7c404903af3d0a1604b37479/users/6820e627fbc64ac0ba1317ae76c7b547/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:04.538503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.538795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.539080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.580496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] MFA Rules not processed for user `6820e627fbc64ac0ba1317ae76c7b547`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:04.585419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:04.655717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 959/1995] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:04.698651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:04.698651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:04.759700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110293fa-3294-47fe-bdce-59cf6c599d72 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:04.763886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f363377-c609-4549-93f6-bd03f44faca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:04.764511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f363377-c609-4549-93f6-bd03f44faca9 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.764797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f363377-c609-4549-93f6-bd03f44faca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.765130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f363377-c609-4549-93f6-bd03f44faca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.776305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f363377-c609-4549-93f6-bd03f44faca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:04.777787 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f363377-c609-4549-93f6-bd03f44faca9 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:04.790089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1037/1996] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:04.808859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:04.880614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81a3bd-c15d-48e8-95b7-c3458f23ef59 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:04.886062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:04.886704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:04.886990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:04.887268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] PATH_INFO: `/v3/users/6820e627fbc64ac0ba1317ae76c7b547` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:04.888482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6820e627fbc64ac0ba1317ae76c7b547)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:04.890466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:05.158380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6820e627fbc64ac0ba1317ae76c7b547'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:05.159324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6820e627fbc64ac0ba1317ae76c7b547'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:05.172715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6820e627fbc64ac0ba1317ae76c7b547'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:05.180479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6820e627fbc64ac0ba1317ae76c7b547'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:05.181323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6820e627fbc64ac0ba1317ae76c7b547'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:05.310889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 960/1997] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:04 2022] DELETE /identity/v3/users/6820e627fbc64ac0ba1317ae76c7b547 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:05.315472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd1953-b887-4872-9196-46096d810edc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:05.315760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd1953-b887-4872-9196-46096d810edc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:05.316039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd1953-b887-4872-9196-46096d810edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:05.336458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-57dd1953-b887-4872-9196-46096d810edc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:05.337717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-57dd1953-b887-4872-9196-46096d810edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:05.400432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:05.402174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1038/1998] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:05.413700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:05.415295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:05.496680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4e6d-76a6-4509-83c7-9314e3ef58e2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:05.500672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7fd0e-e26c-4560-ab32-b4379a6857ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:05.501321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7fd0e-e26c-4560-ab32-b4379a6857ac service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:05.501591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7fd0e-e26c-4560-ab32-b4379a6857ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:05.501868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7fd0e-e26c-4560-ab32-b4379a6857ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:05.512422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7fd0e-e26c-4560-ab32-b4379a6857ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:05.513941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7fd0e-e26c-4560-ab32-b4379a6857ac service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:05.524467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 961/1999] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:06.031701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd1953-b887-4872-9196-46096d810edc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.031994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-57dd1953-b887-4872-9196-46096d810edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:06.045725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd1953-b887-4872-9196-46096d810edc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.050711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.051353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.051669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.051945 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] PATH_INFO: `/v3/projects/62c3628e7c404903af3d0a1604b37479` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.053210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c3628e7c404903af3d0a1604b37479)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.055135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.177406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c3628e7c404903af3d0a1604b37479', 'request_id': 'req-141290dc-a09d-456f-8aef-74bfde9bf757'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:06.307871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c3628e7c404903af3d0a1604b37479', 'request_id': 'req-141290dc-a09d-456f-8aef-74bfde9bf757'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:06.314849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c3628e7c404903af3d0a1604b37479', 'request_id': 'req-141290dc-a09d-456f-8aef-74bfde9bf757'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:06.336134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] The token cache is being invalidate because project 62c3628e7c404903af3d0a1604b37479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:06.336134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:06.336461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-141290dc-a09d-456f-8aef-74bfde9bf757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:06.338214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1039/2000] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:06 2022] DELETE /identity/v3/projects/62c3628e7c404903af3d0a1604b37479 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:06.343261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.344114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.344403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.365749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:06.367179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:06.434350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 962/2001] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:06.448195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.449393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.449802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.471445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:06.472640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:06.481914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1040/2002] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:06.487963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.497108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.497384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:06.499919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d073bc-f164-4f3e-a829-3ce28b0961e2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.506323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.507473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.507760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.508040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.508694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:06.509034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.510648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.524245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:06.527850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 963/2003] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:33:06.530375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.540685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3c7b9-e86a-4795-8b5d-1839c57bec8c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.545695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.546839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.546839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.547068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.547586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.549663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.559821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3966d-733a-4f34-9c37-6f3198ada678 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.565067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.565805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.566035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.566308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.570416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:06.639269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.640749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.651345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1041/2004] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:33:06.706240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 964/2005] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:06 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:33:06.711428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.723073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5f4aa-65f9-43be-ac67-d81616340b73 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.784019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.784688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.785008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.785289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.786349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.788354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.866818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:06.901067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1042/2006] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:06 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:33:06.906341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.916716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d56ab-b166-43bd-b0ec-76ad4a1b516b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.921438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.922046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.922324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.922590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.923418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.925130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.937977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 965/2007] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:06.942431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.954499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7760-f290-48cb-8977-b4c29d555d00 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.960894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263248b0-ee0d-4e1d-82cb-0b372a66d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.960894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263248b0-ee0d-4e1d-82cb-0b372a66d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.961234 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263248b0-ee0d-4e1d-82cb-0b372a66d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.961360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263248b0-ee0d-4e1d-82cb-0b372a66d3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:06.961960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263248b0-ee0d-4e1d-82cb-0b372a66d3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:06.963559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263248b0-ee0d-4e1d-82cb-0b372a66d3c4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:06.974385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1043/2008] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:06.980258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:06.991177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719573b-699c-463a-a8e7-912438193c9d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:06.995923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:06.996597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:06.996926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:06.997209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] PATH_INFO: `/v3/projects/9fa583e84976424da465cc1aba39b974/users/d8e7e20e613b44be9fe65662cd4ea7a1/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:07.013097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa583e84976424da465cc1aba39b974, user_id=d8e7e20e613b44be9fe65662cd4ea7a1, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:07.015771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:07.134792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 966/2009] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:06 2022] PUT /identity/v3/projects/9fa583e84976424da465cc1aba39b974/users/d8e7e20e613b44be9fe65662cd4ea7a1/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:07.146083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:07.146455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:07.146782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:07.175998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] MFA Rules not processed for user `d8e7e20e613b44be9fe65662cd4ea7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:07.177291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:07.241756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1044/2010] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:07.253476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:07.255212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:07.316329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ada20-703f-45d6-a2d6-da0d1a82db4c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:07.320184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6719d0-7b12-4acf-a753-aa924c2f248a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:07.320820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6719d0-7b12-4acf-a753-aa924c2f248a service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:07.321110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6719d0-7b12-4acf-a753-aa924c2f248a service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:07.321388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6719d0-7b12-4acf-a753-aa924c2f248a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:07.330295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6719d0-7b12-4acf-a753-aa924c2f248a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:07.331704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6719d0-7b12-4acf-a753-aa924c2f248a service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:07.340508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 967/2011] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:08.293670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:08.874154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:11.511004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:11.681532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:11.757192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac362f2-3fff-4d0e-895b-585540de452a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:11.761882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:11.762479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:11.762767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:11.763041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] PATH_INFO: `/v3/users/d8e7e20e613b44be9fe65662cd4ea7a1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:11.764200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e7e20e613b44be9fe65662cd4ea7a1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:11.766171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:12.078994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e7e20e613b44be9fe65662cd4ea7a1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:12.091609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e7e20e613b44be9fe65662cd4ea7a1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:12.098811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e7e20e613b44be9fe65662cd4ea7a1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:12.099901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e7e20e613b44be9fe65662cd4ea7a1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:12.136686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:12.219747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e7e20e613b44be9fe65662cd4ea7a1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:12.226705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1045/2012] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:11 2022] DELETE /identity/v3/users/d8e7e20e613b44be9fe65662cd4ea7a1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:12.231080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:12.231449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:12.231738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:12.252317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:12.253655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:12.317463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 968/2013] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:12.328393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:12.330632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:12.401891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c056a3c-6ce7-487b-9d21-ce382997c268 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:12.405816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be79e-db0d-44b8-bd91-220e22c3c447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:12.406371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be79e-db0d-44b8-bd91-220e22c3c447 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:12.406730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be79e-db0d-44b8-bd91-220e22c3c447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:12.406931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be79e-db0d-44b8-bd91-220e22c3c447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:12.424435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be79e-db0d-44b8-bd91-220e22c3c447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:12.425966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be79e-db0d-44b8-bd91-220e22c3c447 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:12.437592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1046/2014] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:13.005423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.008012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:13.028399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482c2d-294d-49fa-9784-78bfa2448c2a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.028399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.028399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.028861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.029820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] PATH_INFO: `/v3/projects/9fa583e84976424da465cc1aba39b974` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.030547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa583e84976424da465cc1aba39b974)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.032536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:13.185233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa583e84976424da465cc1aba39b974', 'request_id': 'req-42721f02-e658-4c41-955a-58684761a79d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:13.264506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa583e84976424da465cc1aba39b974', 'request_id': 'req-42721f02-e658-4c41-955a-58684761a79d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:13.271283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa583e84976424da465cc1aba39b974', 'request_id': 'req-42721f02-e658-4c41-955a-58684761a79d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:13.283343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] The token cache is being invalidate because project 9fa583e84976424da465cc1aba39b974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:13.283637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:13.284351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42721f02-e658-4c41-955a-58684761a79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:13.285897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 969/2015] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:13 2022] DELETE /identity/v3/projects/9fa583e84976424da465cc1aba39b974 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:13.291958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.292559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.292559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.312891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:13.314205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:13.374385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1047/2016] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:13.381880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.382193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.382476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.404168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:13.405457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:13.414846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 970/2017] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:13.418830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.429304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3450b8-a351-4892-b682-459d63efd262 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.434437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.435332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.435332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.435632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.436267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:13.436573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.438211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:13.453938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1048/2018] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:33:13.456643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.466905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6e01-61ed-4b33-93b2-e2d7332ab4cc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.471577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.472180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.472458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.472728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.473388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.475328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:13.608671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 971/2019] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:13 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:13.612966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.624047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c06d-9c50-4dc5-a8b6-71e9a0237266 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.691489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.692110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.692396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.692677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.693438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.695988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:13.780612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1049/2020] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:13 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:13.784724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.795623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3c8f4-48f1-4133-80d9-43cf19178cc6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.800779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.801507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.801788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.802066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.802720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.804359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:13.815216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 972/2021] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:13.819853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.833793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530659e-9234-42e7-ab8b-0e9e78cc82c5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.836265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259186b-e279-48de-a90f-baba356ca237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.836917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259186b-e279-48de-a90f-baba356ca237 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.837200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259186b-e279-48de-a90f-baba356ca237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.837687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259186b-e279-48de-a90f-baba356ca237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.838348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259186b-e279-48de-a90f-baba356ca237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.840014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259186b-e279-48de-a90f-baba356ca237 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:13.851047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1050/2022] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:13.855369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:13.866031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca900c-b520-46b8-b64e-647b2a53d8dc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:13.872013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:13.872849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:13.873209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:13.873559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] PATH_INFO: `/v3/projects/914733969aa74599bdb81228bb0a7397/users/5b7c54213c154c52b2d1810033d79b51/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:13.889691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=914733969aa74599bdb81228bb0a7397, user_id=5b7c54213c154c52b2d1810033d79b51, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:13.905058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:14.053488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 973/2023] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:13 2022] PUT /identity/v3/projects/914733969aa74599bdb81228bb0a7397/users/5b7c54213c154c52b2d1810033d79b51/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:14.064942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:14.065521 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:14.066005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:14.077910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:14.079765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:14.096609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] MFA Rules not processed for user `5b7c54213c154c52b2d1810033d79b51`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:14.097935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:14.147545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e922b-48f2-4ea5-9e04-7cd57551d1ab admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:14.152246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:14.153035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:14.153320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:14.153623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] PATH_INFO: `/v3/users/1e0aa1aec2924f08bad8f32cf66b587c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:14.154772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0aa1aec2924f08bad8f32cf66b587c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:14.156716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:14.164069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1051/2024] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:14.175642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:14.177198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:14.255664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa1c1-9fd1-427b-9b2e-ce482f1dec2d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:14.260315 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d204-8a94-4ca4-9ce1-b4380fe4e6cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:14.260940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d204-8a94-4ca4-9ce1-b4380fe4e6cd service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:14.261227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d204-8a94-4ca4-9ce1-b4380fe4e6cd service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:14.261499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d204-8a94-4ca4-9ce1-b4380fe4e6cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:14.269798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d204-8a94-4ca4-9ce1-b4380fe4e6cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:14.271216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d204-8a94-4ca4-9ce1-b4380fe4e6cd service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:14.279931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1052/2025] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:33:14.389605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0aa1aec2924f08bad8f32cf66b587c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:14.390378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0aa1aec2924f08bad8f32cf66b587c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:14.404786 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0aa1aec2924f08bad8f32cf66b587c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:14.414197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0aa1aec2924f08bad8f32cf66b587c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:14.415368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0aa1aec2924f08bad8f32cf66b587c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:14.516176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 974/2026] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:14 2022] DELETE /identity/v3/users/1e0aa1aec2924f08bad8f32cf66b587c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:14.520565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:14.521055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:14.521162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:14.541832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:14.543562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:14.611331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1053/2027] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:14.636353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:14.638376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:14.715174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87f61-b258-4e42-b0d5-04b28b410c9a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:14.720355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:14.721253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:14.721909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:14.722187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:14.734091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:14.735606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:14.755893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 975/2028] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:14.836682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:15.238244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:15.239690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:15.252883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff4de-91d7-4fe3-a92a-7330fe045d3e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:15.258796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:15.259630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:15.260097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:15.260645 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] PATH_INFO: `/v3/projects/1c36f40764cb4cbfb70b10ca12b13536` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:15.262083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c36f40764cb4cbfb70b10ca12b13536)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:15.264541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:15.390777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c36f40764cb4cbfb70b10ca12b13536', 'request_id': 'req-0a7137ab-c23b-4f9d-b374-e46782846e85'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.419152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:15.534393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c36f40764cb4cbfb70b10ca12b13536', 'request_id': 'req-0a7137ab-c23b-4f9d-b374-e46782846e85'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.543946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c36f40764cb4cbfb70b10ca12b13536', 'request_id': 'req-0a7137ab-c23b-4f9d-b374-e46782846e85'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.557071 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] The token cache is being invalidate because project 1c36f40764cb4cbfb70b10ca12b13536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:15.557372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.558064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.559685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1054/2029] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:15 2022] DELETE /identity/v3/projects/1c36f40764cb4cbfb70b10ca12b13536 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:15.564532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:15.577001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010790-9ab8-4436-a141-b3a9fc583650 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:15.638225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:15.638861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:15.639140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:15.639414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] PATH_INFO: `/v3/users/6c4afb0540aa44fda6de16f8a7817f5e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:15.640530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4afb0540aa44fda6de16f8a7817f5e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:15.642661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:15.918889 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4afb0540aa44fda6de16f8a7817f5e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.919160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4afb0540aa44fda6de16f8a7817f5e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.961038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4afb0540aa44fda6de16f8a7817f5e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.969901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4afb0540aa44fda6de16f8a7817f5e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:15.970632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b0b52d64-c07d-4f10-a21b-7561822c2c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4afb0540aa44fda6de16f8a7817f5e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:16.100547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 976/2030] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:15 2022] DELETE /identity/v3/users/6c4afb0540aa44fda6de16f8a7817f5e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:16.544153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:16.546631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:16.563549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7137ab-c23b-4f9d-b374-e46782846e85 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:16.627135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:16.627877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:16.628164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:16.628443 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] PATH_INFO: `/v3/projects/b9e76bd43f4046f7a400ad238fd1e030` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:16.629748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e76bd43f4046f7a400ad238fd1e030)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:16.631725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:16.905307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e76bd43f4046f7a400ad238fd1e030', 'request_id': 'req-8423e4a9-9d63-43bc-94d5-8a02789d506c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:17.018681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e76bd43f4046f7a400ad238fd1e030', 'request_id': 'req-8423e4a9-9d63-43bc-94d5-8a02789d506c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:17.026981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e76bd43f4046f7a400ad238fd1e030', 'request_id': 'req-8423e4a9-9d63-43bc-94d5-8a02789d506c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:17.040037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] The token cache is being invalidate because project b9e76bd43f4046f7a400ad238fd1e030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:17.040469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:17.041146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8423e4a9-9d63-43bc-94d5-8a02789d506c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:17.042745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1055/2031] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:16 2022] DELETE /identity/v3/projects/b9e76bd43f4046f7a400ad238fd1e030 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:17.048961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.049627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.049732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.070731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:17.071954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:17.140842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 977/2032] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:17.149631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.150026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.150385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.172350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:17.173620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:17.181920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1056/2033] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:17.186358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:17.196339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d1003-fc9e-463c-aaef-4088d0255b29 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:17.202437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:17.202437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.202437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.202437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.203048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:17.203358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:17.205099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:17.220791 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 978/2034] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:33:17.225915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:17.236365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee89ec-a6bd-4264-bbac-27bd1ff5eee3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:17.242238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:17.242844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.243172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.243447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.244102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:17.245999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:17.421662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1057/2035] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:17 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:17.427558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:17.438651 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55295f-dffd-478a-a029-73c17ea0b401 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:17.496475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:17.513946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:17.514620 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.514904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.515183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.515883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:17.517935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:17.641516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 979/2036] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:17 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:17.641868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:17.650123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52487-a4a8-4058-a54b-be9353b1a721 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:17.655099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:17.655550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.655833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.656111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.656872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:17.658540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:17.671793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1058/2037] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:17.688208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:17.689919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5537486-d93e-4893-a152-2b4c32005a0f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:17.694708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415582-6763-421d-9f41-d87e741930d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:17.695315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415582-6763-421d-9f41-d87e741930d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.695601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415582-6763-421d-9f41-d87e741930d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.695878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415582-6763-421d-9f41-d87e741930d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.696534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415582-6763-421d-9f41-d87e741930d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:17.698309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415582-6763-421d-9f41-d87e741930d9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:17.714036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 980/2038] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:17.718675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:17.732100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567002c-737a-4c60-9fa8-dfa6a9d8a4a8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:17.737278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:17.745120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.745120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.745120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] PATH_INFO: `/v3/projects/012597985e5c4aebb72ca1231023bbb0/users/e452f84bb1424d0d803859d830025436/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.756429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012597985e5c4aebb72ca1231023bbb0, user_id=e452f84bb1424d0d803859d830025436, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:17.759394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:17.833754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1059/2039] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:17 2022] PUT /identity/v3/projects/012597985e5c4aebb72ca1231023bbb0/users/e452f84bb1424d0d803859d830025436/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:17.845602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:17.845893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:17.846174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:17.880129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] MFA Rules not processed for user `e452f84bb1424d0d803859d830025436`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:17.881478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:17.959567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 981/2040] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:18.037577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:18.039376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:18.099075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec8da-bed1-46fd-b9eb-7a719ffcd601 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:18.103106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841ce49-308b-446a-9d9e-bc6f6c736dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:18.103740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841ce49-308b-446a-9d9e-bc6f6c736dbc service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:18.104026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841ce49-308b-446a-9d9e-bc6f6c736dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:18.104303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841ce49-308b-446a-9d9e-bc6f6c736dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:18.113249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841ce49-308b-446a-9d9e-bc6f6c736dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:18.114738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841ce49-308b-446a-9d9e-bc6f6c736dbc service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:18.124336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1060/2041] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:18.137217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:18.161527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:18.248781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288bd24-7cdd-43ba-afd6-fce25ae14389 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:18.253339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:18.253970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:18.254259 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:18.254539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] PATH_INFO: `/v3/users/e452f84bb1424d0d803859d830025436` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:18.255676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e452f84bb1424d0d803859d830025436)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:18.258358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:18.495670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e452f84bb1424d0d803859d830025436'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:18.496353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e452f84bb1424d0d803859d830025436'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:18.510813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e452f84bb1424d0d803859d830025436'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:18.517744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e452f84bb1424d0d803859d830025436'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:18.520112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e452f84bb1424d0d803859d830025436'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:18.641542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 982/2042] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:18 2022] DELETE /identity/v3/users/e452f84bb1424d0d803859d830025436 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:18.646377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:18.647100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:18.647293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:18.666459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:18.667691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:18.729355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1061/2043] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:18.742450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:18.742450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:18.805074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0af6-352c-461b-98f8-fd0a2f335abf admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:18.809249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c06d64-13c9-4ed6-b43c-5486bc5fc7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:18.809893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c06d64-13c9-4ed6-b43c-5486bc5fc7db service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:18.810175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c06d64-13c9-4ed6-b43c-5486bc5fc7db service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:18.810574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c06d64-13c9-4ed6-b43c-5486bc5fc7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:18.820005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c06d64-13c9-4ed6-b43c-5486bc5fc7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:18.821544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c06d64-13c9-4ed6-b43c-5486bc5fc7db service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:18.832311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 983/2044] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:19.484126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:19.485581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:19.497954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f3a3d-a102-4c4c-8f05-f54a21f5207a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:19.502934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:19.503361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:19.503647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:19.503956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] PATH_INFO: `/v3/projects/012597985e5c4aebb72ca1231023bbb0` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:19.505159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012597985e5c4aebb72ca1231023bbb0)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:19.507685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:19.635271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012597985e5c4aebb72ca1231023bbb0', 'request_id': 'req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:19.809189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012597985e5c4aebb72ca1231023bbb0', 'request_id': 'req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:19.816499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012597985e5c4aebb72ca1231023bbb0', 'request_id': 'req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:19.840146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] The token cache is being invalidate because project 012597985e5c4aebb72ca1231023bbb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:19.840146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:19.840146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd8017f8-8c78-4a96-bf26-02cb7cd0ac47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:19.840146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1062/2045] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:19 2022] DELETE /identity/v3/projects/012597985e5c4aebb72ca1231023bbb0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:19.846752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:19.847292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:19.847292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:19.868236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:19.869768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:19.954644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 984/2046] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:19.957352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:19.957853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:19.958376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:19.985786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:19.986785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:20.002230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1063/2047] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:20.007027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.020299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73155-ebd8-4767-85ea-91939ff5af43 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.025940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.026160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.026430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.026698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.027342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:20.027817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.029876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.039075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:20.044606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 985/2048] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:33:20.049301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.059627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0199ae-c32c-4217-8019-16d640888277 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.065641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.066476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.066842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.067236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.068198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.070895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.190808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1064/2049] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:20 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:20.191995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.203478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732c7de-fb79-490b-89ca-c61f97661fe8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.266191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.266754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.266999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.267276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.267965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.269926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.395112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 986/2050] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:20 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:20.396308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.413409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2415c78-49ec-4483-94f0-73cd34ef6eb8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.419350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.420640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.421115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.421551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.423743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.425959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.455747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1065/2051] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:20.460957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.472077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0cfd-35c1-4633-a468-84846f28767d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.478897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990d7a0-be33-44ba-bb6f-1c240ebfbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.479911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990d7a0-be33-44ba-bb6f-1c240ebfbfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.479911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990d7a0-be33-44ba-bb6f-1c240ebfbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.480126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990d7a0-be33-44ba-bb6f-1c240ebfbfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.480891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990d7a0-be33-44ba-bb6f-1c240ebfbfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.482577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990d7a0-be33-44ba-bb6f-1c240ebfbfc7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.497128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 987/2052] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:20.499334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.509891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d69e89-9fb0-40f7-accb-11aa2185a9fe admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.514849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.515444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.515726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.515999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] PATH_INFO: `/v3/projects/3c8606a15152432f8e4ec96bb7347af4/users/e50c70f6817e4c0f96317a9ff305aca7/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.533560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8606a15152432f8e4ec96bb7347af4, user_id=e50c70f6817e4c0f96317a9ff305aca7, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.537299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.667068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1066/2053] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:20 2022] PUT /identity/v3/projects/3c8606a15152432f8e4ec96bb7347af4/users/e50c70f6817e4c0f96317a9ff305aca7/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:20.677854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819c5fe-516f-450e-be95-a2a835fb769f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.678135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819c5fe-516f-450e-be95-a2a835fb769f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.678465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819c5fe-516f-450e-be95-a2a835fb769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.708165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5819c5fe-516f-450e-be95-a2a835fb769f None None] MFA Rules not processed for user `e50c70f6817e4c0f96317a9ff305aca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:20.709364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5819c5fe-516f-450e-be95-a2a835fb769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:20.778006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 988/2054] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:21.405639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:22.013198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:22.451918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:23.201777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.100822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.230223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:25.544338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:25.691213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:26.179869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:27.091159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:27.448066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:27.463179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:27.518664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34a39-6c99-49f6-a6ea-28c7a540fc6c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:27.523709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:27.524351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:27.524635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:27.525079 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] PATH_INFO: `/v3/users/71416979ab694b1782e1b66af429a6e2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:27.526242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71416979ab694b1782e1b66af429a6e2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:27.528227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:27.747758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71416979ab694b1782e1b66af429a6e2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:27.761233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71416979ab694b1782e1b66af429a6e2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:27.768100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71416979ab694b1782e1b66af429a6e2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:27.768897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71416979ab694b1782e1b66af429a6e2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:27.870897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71416979ab694b1782e1b66af429a6e2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:27.878099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1067/2055] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:27 2022] DELETE /identity/v3/users/71416979ab694b1782e1b66af429a6e2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:27.882870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:27.883186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:27.883463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:27.905647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:27.908324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:27.987037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 989/2056] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:27.998744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:28.000248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:28.036642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:28.077861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d80eb5-acbf-4c17-b216-068ad50fe503 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:28.081622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b9c8-20a6-4e17-833e-8e133561243b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:28.082295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b9c8-20a6-4e17-833e-8e133561243b service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:28.082576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b9c8-20a6-4e17-833e-8e133561243b service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:28.082850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b9c8-20a6-4e17-833e-8e133561243b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:28.092508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b9c8-20a6-4e17-833e-8e133561243b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:28.093993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b9c8-20a6-4e17-833e-8e133561243b service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:28.105105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1068/2057] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:28.553111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:28.556401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:28.567717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e444-45e6-4ff5-86d0-b97a181b6f4c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:28.573257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:28.574154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:28.575481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:28.575481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] PATH_INFO: `/v3/projects/285e2bb041bb4b42995c4c2d87951429` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:28.577362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:28.578279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=285e2bb041bb4b42995c4c2d87951429)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:28.580429 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:28.704666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285e2bb041bb4b42995c4c2d87951429', 'request_id': 'req-71542e8a-a5d9-49b8-b658-e5299f00b4ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:28.784360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285e2bb041bb4b42995c4c2d87951429', 'request_id': 'req-71542e8a-a5d9-49b8-b658-e5299f00b4ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:28.791605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285e2bb041bb4b42995c4c2d87951429', 'request_id': 'req-71542e8a-a5d9-49b8-b658-e5299f00b4ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:28.802563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] The token cache is being invalidate because project 285e2bb041bb4b42995c4c2d87951429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:28.802795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:28.803469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71542e8a-a5d9-49b8-b658-e5299f00b4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:28.805181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 990/2058] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:28 2022] DELETE /identity/v3/projects/285e2bb041bb4b42995c4c2d87951429 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:28.810782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:28.814584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:28.814584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:28.832629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:28.833896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:28.902905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1069/2059] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:28.912893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:28.915084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:28.915084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:28.934951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:28.936178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:28.945263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 991/2060] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:28.949593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:28.959888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd86830-4d4d-47ea-bf35-2e08a4bc5ee5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:28.966980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:28.967741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:28.968138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:28.968551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:28.969437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:28.969805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:28.972144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:28.988128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1070/2061] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:33:28.993007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:29.002578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324adae-2ee2-4305-b49d-9aafb61e9bd3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:29.009606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:29.010599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:29.011007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:29.011309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:29.011965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:29.013955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:29.139204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 992/2062] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:28 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:29.143518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:29.154673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107d3c-33bb-41f3-b011-195765342c3f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:29.218845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:29.219502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:29.219790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:29.220070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:29.220746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:29.222915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:29.364027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1071/2063] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:29 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:29.369363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:29.385313 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ee6b-0320-4ef5-b6f7-08b4d57d7bd8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:29.390236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:29.390847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:29.391263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:29.391428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:29.392015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:29.394442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:29.404704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 993/2064] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:29.409540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:29.423334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989aa5b-9773-4e03-9700-ba9ea15823eb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:29.432052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:29.433677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8308c81-48a2-4cde-90fc-5545dc72ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:29.435473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308c81-48a2-4cde-90fc-5545dc72ce6b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:29.435473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308c81-48a2-4cde-90fc-5545dc72ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:29.435473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308c81-48a2-4cde-90fc-5545dc72ce6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:29.436441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8308c81-48a2-4cde-90fc-5545dc72ce6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:29.438159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8308c81-48a2-4cde-90fc-5545dc72ce6b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:29.455287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1072/2065] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:29.461008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:29.476916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2009-cd2b-41c9-8766-92d876b792f2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:29.486868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:29.488004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:29.488549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:29.489075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] PATH_INFO: `/v3/projects/1788e8387ff3470b890e100b2e64ee2f/users/5b72ffcbfc254442bd8f63d2c5c81504/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:29.510897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1788e8387ff3470b890e100b2e64ee2f, user_id=5b72ffcbfc254442bd8f63d2c5c81504, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:29.513993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:29.607094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 994/2066] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:29 2022] PUT /identity/v3/projects/1788e8387ff3470b890e100b2e64ee2f/users/5b72ffcbfc254442bd8f63d2c5c81504/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:29.619115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:29.619478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:29.619766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:29.649355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] MFA Rules not processed for user `5b72ffcbfc254442bd8f63d2c5c81504`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:29.650478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:29.726422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1073/2067] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:33:29.910203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:30.435410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:30.864862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:31.622468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:32.423258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:33.264547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:33.388104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:33.910098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:33.912225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:33.983980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381807-737e-4ce7-8e02-d0228f7c13f0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:33.988352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:33.989027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:33.989317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:33.989597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:33.992032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:34.053777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:34.055298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a3ef7-40db-4b48-80ba-9f825a873f33 service glance] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:34.066168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 995/2068] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:34.091106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:34.102783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737535-b950-4537-a01a-3bc08129aa78 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:34.107209 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:34.108026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:34.108391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:34.108789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:34.118782 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:34.120278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:34.129635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1074/2069] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:33:34.684126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:34.934585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:36.392409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:37.087000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:37.896538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:38.299257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:39.676042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:40.498125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:41.430275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:42.652397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:42.715322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:43.104857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:43.591166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59c95-e743-46c2-ac53-35963ee18657 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:43.591668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59c95-e743-46c2-ac53-35963ee18657 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:43.592063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba59c95-e743-46c2-ac53-35963ee18657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:43.612939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0ba59c95-e743-46c2-ac53-35963ee18657 None None] MFA Rules not processed for user `bec99c3414d44b85981e0122b0b4aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:43.614610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0ba59c95-e743-46c2-ac53-35963ee18657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:43.681015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 996/2070] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:43.766851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:44.250578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:45.420452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:46.121214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:47.915503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:48.164900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:48.759420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:49.102545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:49.549867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:50.281120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:50.875332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:50.951660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:50.953469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:51.019375 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f917c3-5493-4d38-94ed-097dcf2b3c4e service glance] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:51.026459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:51.027463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:51.027882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:51.028164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] PATH_INFO: `/v3/users/5b7c54213c154c52b2d1810033d79b51` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:51.029622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7c54213c154c52b2d1810033d79b51)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:51.031567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:51.254558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7c54213c154c52b2d1810033d79b51'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:51.266851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7c54213c154c52b2d1810033d79b51'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:51.281126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7c54213c154c52b2d1810033d79b51'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:51.281126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7c54213c154c52b2d1810033d79b51'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:51.432892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7c54213c154c52b2d1810033d79b51'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:51.439424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1075/2071] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:33:50 2022] DELETE /identity/v3/users/5b7c54213c154c52b2d1810033d79b51 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:51.445013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:51.445522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:51.445672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:51.467498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:51.468877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:51.529171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 997/2072] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:51.541536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:51.543117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:51.550623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:51.583691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:51.603695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05334c8b-397d-496f-a883-83135bc8374f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:51.607984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93a9e-e2f0-41c4-88ed-1268be4afe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:51.608675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93a9e-e2f0-41c4-88ed-1268be4afe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:51.609175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93a9e-e2f0-41c4-88ed-1268be4afe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:51.609461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93a9e-e2f0-41c4-88ed-1268be4afe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:51.621326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b93a9e-e2f0-41c4-88ed-1268be4afe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:51.623174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b93a9e-e2f0-41c4-88ed-1268be4afe16 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:51.633689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1076/2073] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:52.109610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:52.185396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:52.186933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:52.199618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd82be-7b46-493d-8627-b9a20480ce68 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:52.204270 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:52.204949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:52.205238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:52.205508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] PATH_INFO: `/v3/projects/914733969aa74599bdb81228bb0a7397` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:52.206655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] RBAC: Authorizing `identity:delete_project(project_id=914733969aa74599bdb81228bb0a7397)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:52.208571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:52.349531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:52.352759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914733969aa74599bdb81228bb0a7397', 'request_id': 'req-81d7fd3c-83aa-48f4-9d76-badeeeac601a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:52.480989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914733969aa74599bdb81228bb0a7397', 'request_id': 'req-81d7fd3c-83aa-48f4-9d76-badeeeac601a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:52.487872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914733969aa74599bdb81228bb0a7397', 'request_id': 'req-81d7fd3c-83aa-48f4-9d76-badeeeac601a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:52.497885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] The token cache is being invalidate because project 914733969aa74599bdb81228bb0a7397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:33:52.498173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:52.498813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81d7fd3c-83aa-48f4-9d76-badeeeac601a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:33:52.500413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 998/2074] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:33:52 2022] DELETE /identity/v3/projects/914733969aa74599bdb81228bb0a7397 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:33:52.505774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:52.506812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:52.506812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:52.530506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:52.531756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:52.594810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1077/2075] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:52.604001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:52.604513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:52.604796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:52.625534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:52.626745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:52.635514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 999/2076] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:52.639825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:52.650650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122bc9d-0878-44e0-8812-24f8b32bda0f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:52.656398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:52.657128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:52.657414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:52.657694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:52.658365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:33:52.658672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:52.660319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:52.673405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1078/2077] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:33:52.677748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:52.687689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7b330-b79e-4b4b-9ac8-1877b44e2725 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:52.692596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:52.693251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:52.693556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:52.693880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:52.694520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:52.696432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:52.785106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1000/2078] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:33:52 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:33:52.789147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:52.799444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66aaa-f199-4780-95e6-90d94a671d88 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:52.877786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:52.878633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:52.879010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:52.879397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:52.880129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:52.883041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:52.901844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:52.988084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1079/2079] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:33:52 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:33:52.992904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:53.003322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a99dff-b48e-474f-90b3-b8bfb93862a6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:53.008784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:53.009461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:53.009770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:53.010182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:53.010869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:53.012504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:53.025046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1001/2080] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:33:53.028643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:53.039962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7adf-4b2a-40ba-880f-4a2d7b51855e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:53.044874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122abb58-bfe6-4982-b967-5fe5a6c83d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:53.045490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122abb58-bfe6-4982-b967-5fe5a6c83d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:53.045778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122abb58-bfe6-4982-b967-5fe5a6c83d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:53.046054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122abb58-bfe6-4982-b967-5fe5a6c83d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:53.046701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122abb58-bfe6-4982-b967-5fe5a6c83d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:53.048467 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122abb58-bfe6-4982-b967-5fe5a6c83d11 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:53.052168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:53.060573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1080/2081] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:33:53.064732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:53.075392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2f4b0-dbaf-4bd3-a92b-75aef1efe2f6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:53.080309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:53.080686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:53.081004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:53.081283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] PATH_INFO: `/v3/projects/95b1d47c4d37488fa99efdebd25b77a4/users/e0ff1ee6a1864a198d533e341d9c1bf2/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:53.099006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b1d47c4d37488fa99efdebd25b77a4, user_id=e0ff1ee6a1864a198d533e341d9c1bf2, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:53.102234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:53.269408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1002/2082] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:33:53 2022] PUT /identity/v3/projects/95b1d47c4d37488fa99efdebd25b77a4/users/e0ff1ee6a1864a198d533e341d9c1bf2/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:33:53.280318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:53.280522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:53.280793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:53.310585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] MFA Rules not processed for user `e0ff1ee6a1864a198d533e341d9c1bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:53.311810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:53.389920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1081/2083] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:53.401329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:53.403114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:53.468380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc361068-5d2a-4a92-9a0b-700f5ae9dddd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:53.472323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc7c59-3057-4425-877f-6abf679a1917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:53.473159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc7c59-3057-4425-877f-6abf679a1917 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:53.474615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc7c59-3057-4425-877f-6abf679a1917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:53.474615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc7c59-3057-4425-877f-6abf679a1917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:53.485107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc7c59-3057-4425-877f-6abf679a1917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:53.486554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc7c59-3057-4425-877f-6abf679a1917 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:53.496522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1003/2084] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:53.577693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:53.644457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:54.438778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:54.948606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:55.087062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:55.750504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:56.143516 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:56.680756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:57.047023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:57.305090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:57.783695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:57.987389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:58.104121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:03.732419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:03.733918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:03.823631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf1b8-6e04-492e-b27a-4c5d65e67a99 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:03.831210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:03.832341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:03.832918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:03.833438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] PATH_INFO: `/v3/users/e50c70f6817e4c0f96317a9ff305aca7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:03.835724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50c70f6817e4c0f96317a9ff305aca7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:03.838236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:04.113038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50c70f6817e4c0f96317a9ff305aca7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:04.129785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50c70f6817e4c0f96317a9ff305aca7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:04.142057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50c70f6817e4c0f96317a9ff305aca7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:04.143041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50c70f6817e4c0f96317a9ff305aca7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:04.242008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50c70f6817e4c0f96317a9ff305aca7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:04.253805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1082/2085] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:34:03 2022] DELETE /identity/v3/users/e50c70f6817e4c0f96317a9ff305aca7 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:04.255626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:04.257188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:04.257619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:04.307424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:04.309456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:04.447700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1004/2086] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:04.460919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:04.463934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:04.578912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:04.584462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57192a-8b72-4845-9d9a-2ec67e2813e0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:04.592873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413c980-bf39-4fd8-8a2d-0814eaedc06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:04.596402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413c980-bf39-4fd8-8a2d-0814eaedc06f service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:04.596878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413c980-bf39-4fd8-8a2d-0814eaedc06f service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:04.601457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413c980-bf39-4fd8-8a2d-0814eaedc06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:04.624345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413c980-bf39-4fd8-8a2d-0814eaedc06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:04.625827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413c980-bf39-4fd8-8a2d-0814eaedc06f service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:04.647685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1083/2087] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:05.346775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:05.348237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:05.365803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18282884-3b45-4626-9f9a-386fffed96a5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:05.378609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:05.380433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:05.381632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:05.382897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] PATH_INFO: `/v3/projects/3c8606a15152432f8e4ec96bb7347af4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:05.384497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8606a15152432f8e4ec96bb7347af4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:05.388089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:05.587784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8606a15152432f8e4ec96bb7347af4', 'request_id': 'req-75ccf685-65a9-4889-9cf0-e5b3804deafe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:05.727192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8606a15152432f8e4ec96bb7347af4', 'request_id': 'req-75ccf685-65a9-4889-9cf0-e5b3804deafe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:05.766338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8606a15152432f8e4ec96bb7347af4', 'request_id': 'req-75ccf685-65a9-4889-9cf0-e5b3804deafe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:05.796524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] The token cache is being invalidate because project 3c8606a15152432f8e4ec96bb7347af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:34:05.800149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:05.803758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75ccf685-65a9-4889-9cf0-e5b3804deafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:05.810000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1005/2088] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:34:05 2022] DELETE /identity/v3/projects/3c8606a15152432f8e4ec96bb7347af4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:05.815600 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:05.816150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:05.816150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:05.847709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:05.847709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:05.931264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1084/2089] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:05.943187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:05.943725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:05.944007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:05.977325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:05.978592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:05.986821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1006/2090] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:05.995163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.006969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4baf68-cea6-49b5-9ac6-74bfaebbdbbe None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:06.011925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:06.012528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.012835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.013120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.013779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:34:06.014080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:06.015791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:06.029505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1085/2091] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:34:06.039861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.050285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295eb14-7e3f-45cd-bead-2ff3da17e2b2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:06.055582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:06.056285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.056672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.057146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.057879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:06.060148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:06.303468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1007/2092] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:34:06 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:06.308145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.322087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5626187-d88d-4269-83a4-62b6dd16feda admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:06.390372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:06.390990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.391267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.391542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.392200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:06.394169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:06.538360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1086/2093] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:34:06 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:06.543336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.555104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d600c-7a20-4193-b9c7-89ca47e030cd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:06.560037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:06.560659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.561007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.561291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.561948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:06.563575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:06.575274 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1008/2094] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:06.579505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.589998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a167-c62f-41f7-8d8d-15c712ca7b50 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:06.594929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623739e-cdf0-42d4-bc7f-c6312baf2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:06.595543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623739e-cdf0-42d4-bc7f-c6312baf2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.595827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623739e-cdf0-42d4-bc7f-c6312baf2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.596104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623739e-cdf0-42d4-bc7f-c6312baf2fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.596767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623739e-cdf0-42d4-bc7f-c6312baf2fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:06.598713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623739e-cdf0-42d4-bc7f-c6312baf2fc8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:06.613332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1087/2095] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:06.614714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.626272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a22cb-3247-45d8-99c6-e3b432123b2d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:06.632196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:06.632937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.633218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.633491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] PATH_INFO: `/v3/projects/5666c343a15e4ac48b67031d9c702b8b/users/a7e527a5681648ac84b81415edf42256/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.652325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5666c343a15e4ac48b67031d9c702b8b, user_id=a7e527a5681648ac84b81415edf42256, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:06.655155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:06.778588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:06.785878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1009/2096] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:34:06 2022] PUT /identity/v3/projects/5666c343a15e4ac48b67031d9c702b8b/users/a7e527a5681648ac84b81415edf42256/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:06.791977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee69b7f-d3c0-4aa6-bc06-4556e67c116b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:06.792519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee69b7f-d3c0-4aa6-bc06-4556e67c116b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:06.793015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee69b7f-d3c0-4aa6-bc06-4556e67c116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:06.818469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dee69b7f-d3c0-4aa6-bc06-4556e67c116b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:06.821296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dee69b7f-d3c0-4aa6-bc06-4556e67c116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:06.873574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:06.885844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1088/2097] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:06.896746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:06.899476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:06.995535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df66366-3f97-44e3-9bea-96d481d7fec9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:07.001690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:07.002623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:07.002898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:07.003352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:07.017863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:07.022473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:07.040232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1010/2098] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:09.346246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:09.346902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:09.346902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:09.375879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] MFA Rules not processed for user `a7e527a5681648ac84b81415edf42256`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:09.377159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:09.450264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1089/2099] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:09.461197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:09.463200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:09.534628 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b124c7-f0b0-4139-bb96-dee86bff76ee service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:09.538783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:09.539597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:09.539888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:09.540165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:09.554610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:09.556117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:09.570717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1011/2100] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:10.138430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:10.139992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:10.156286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c7fb-2d62-4619-a64c-35ce79aac78c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:10.161378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:10.163064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:10.165638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:10.166286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:10.166571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:10.166925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] PATH_INFO: `/v3/users/9fe79a1b63b6450f940956a7723b39ed` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:10.169101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe79a1b63b6450f940956a7723b39ed)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:10.172402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:10.188968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00c9db-0268-430c-abe6-078a09f896a5 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:10.222652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:10.222652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:10.222652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:10.222652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] PATH_INFO: `/v3/users/e0ff1ee6a1864a198d533e341d9c1bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:10.223314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ff1ee6a1864a198d533e341d9c1bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:10.225414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:10.491825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe79a1b63b6450f940956a7723b39ed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.517875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe79a1b63b6450f940956a7723b39ed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.529384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe79a1b63b6450f940956a7723b39ed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.530088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe79a1b63b6450f940956a7723b39ed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.562007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ff1ee6a1864a198d533e341d9c1bf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.563525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ff1ee6a1864a198d533e341d9c1bf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.583549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ff1ee6a1864a198d533e341d9c1bf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.593600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ff1ee6a1864a198d533e341d9c1bf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.594353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9ae7b43f-8da8-4a08-a8fa-3f841ac9a653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ff1ee6a1864a198d533e341d9c1bf2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.680470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47b11f07-4f9c-40b9-9ac8-81f1d0a5e350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe79a1b63b6450f940956a7723b39ed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:10.687136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1090/2101] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:34:10 2022] DELETE /identity/v3/users/9fe79a1b63b6450f940956a7723b39ed => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:10.691648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:10.691935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:10.692212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:10.715955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:10.717729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:10.804262 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:10.816940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1091/2102] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:34:10.844385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:10.852866 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:10.857466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1012/2103] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:34:10 2022] DELETE /identity/v3/users/e0ff1ee6a1864a198d533e341d9c1bf2 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:10.861722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:10.862016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:10.862291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:10.901520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:10.902982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:10.925978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:10.955096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc6ef7-014f-4bff-9615-fd23aaa5166b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:10.996611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1013/2104] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:34:11.013859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:11.030707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e2512-8aa9-4347-abbc-c8c467e34b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:11.031461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2512-8aa9-4347-abbc-c8c467e34b32 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:11.031805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2512-8aa9-4347-abbc-c8c467e34b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:11.032147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2512-8aa9-4347-abbc-c8c467e34b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:11.043629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e2512-8aa9-4347-abbc-c8c467e34b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:11.045463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e2512-8aa9-4347-abbc-c8c467e34b32 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:11.059550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1092/2105] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:34:11.098458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33894b-016b-463c-aff2-1c63f36f10d7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:11.104559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:11.104767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:11.105070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:11.105664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:11.117901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:11.120055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:11.137117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1014/2106] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:11.778809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:11.779391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:11.779391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:11.800497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] MFA Rules not processed for user `69684b11ca0c4af08d081da48b898115`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:11.801822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:11.862113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1093/2107] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:11.917412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:11.917412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:11.922881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:11.924486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:11.953315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299ecc1-7320-45cb-a37d-f3572908ce82 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:11.957327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26f68c-f5c6-4a92-9bfe-801a545e927a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:11.963821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:11.964404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:11.965822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:11.966745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:11.967295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] PATH_INFO: `/v3/projects/da044f6778594166a30d2baaee72f93c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:11.970404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da044f6778594166a30d2baaee72f93c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:11.973926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:11.975221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:11.975817 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] PATH_INFO: `/v3/projects/95b1d47c4d37488fa99efdebd25b77a4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:11.977947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b1d47c4d37488fa99efdebd25b77a4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:11.980055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:11.988253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:12.254225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da044f6778594166a30d2baaee72f93c', 'request_id': 'req-61507454-b2eb-4700-acef-527c9498d6f1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.313305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b1d47c4d37488fa99efdebd25b77a4', 'request_id': 'req-2dce6bc1-9685-4e48-b75a-3ebc012aa404'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.354321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da044f6778594166a30d2baaee72f93c', 'request_id': 'req-61507454-b2eb-4700-acef-527c9498d6f1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.363967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da044f6778594166a30d2baaee72f93c', 'request_id': 'req-61507454-b2eb-4700-acef-527c9498d6f1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.386354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] The token cache is being invalidate because project da044f6778594166a30d2baaee72f93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:34:12.387161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.390267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61507454-b2eb-4700-acef-527c9498d6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.398615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1015/2108] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:34:11 2022] DELETE /identity/v3/projects/da044f6778594166a30d2baaee72f93c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:12.400649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e14d-cd24-4cbc-b4ce-ef73fcc75fc7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.401039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e14d-cd24-4cbc-b4ce-ef73fcc75fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.401390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e14d-cd24-4cbc-b4ce-ef73fcc75fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.464533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a233e14d-cd24-4cbc-b4ce-ef73fcc75fc7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:12.465880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a233e14d-cd24-4cbc-b4ce-ef73fcc75fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:12.538579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b1d47c4d37488fa99efdebd25b77a4', 'request_id': 'req-2dce6bc1-9685-4e48-b75a-3ebc012aa404'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.565276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b1d47c4d37488fa99efdebd25b77a4', 'request_id': 'req-2dce6bc1-9685-4e48-b75a-3ebc012aa404'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.567605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1016/2109] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:12.577686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.579499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.580233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.597173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] The token cache is being invalidate because project 95b1d47c4d37488fa99efdebd25b77a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:34:12.597497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.598192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2dce6bc1-9685-4e48-b75a-3ebc012aa404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:12.603987 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1094/2110] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:34:11 2022] DELETE /identity/v3/projects/95b1d47c4d37488fa99efdebd25b77a4 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:34:12.605663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5d18-ca5c-4f0c-8cd0-a6633467c88e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.605960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5d18-ca5c-4f0c-8cd0-a6633467c88e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.606237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5d18-ca5c-4f0c-8cd0-a6633467c88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.630518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:12.633356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:12.644697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1017/2111] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:12.661596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:12.667586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-48fe5d18-ca5c-4f0c-8cd0-a6633467c88e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:12.667586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-48fe5d18-ca5c-4f0c-8cd0-a6633467c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:12.680224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5f906-ae1b-42cd-be93-825bda0ea624 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:12.696733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1095/2112] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:12.698846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.699149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.699435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.701789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:12.702689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.703349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.704020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.705331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:34:12.705937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:12.710771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:12.730177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1018/2113] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:34:12.735540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:12.742165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:12.744025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:12.750204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d81e8-6d9c-4398-8af8-f7966f0f04d8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:12.757373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167d83d-c745-4b8f-98ab-558781a12945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:12.758146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d83d-c745-4b8f-98ab-558781a12945 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.758428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d83d-c745-4b8f-98ab-558781a12945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.758933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1096/2114] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:12.761494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d83d-c745-4b8f-98ab-558781a12945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.762760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167d83d-c745-4b8f-98ab-558781a12945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:12.766520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:12.770750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167d83d-c745-4b8f-98ab-558781a12945 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:12.798968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fc348-d358-46dc-93b6-4c5f31bfa4a6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:12.804992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:12.806241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.806724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.807166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.808007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:34:12.808477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:12.810338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:12.828039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1097/2115] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:34:12.833593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:12.844747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659afe28-49fb-4fa0-9db3-a6e752a887ba admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:12.850456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:12.850796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.851037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.851321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.852085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:12.854056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:12.956645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1019/2116] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:12.957995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:12.958266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:12.958553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:12.979633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] MFA Rules not processed for user `a7e527a5681648ac84b81415edf42256`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:12.980884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:13.042793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1020/2117] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:13.043808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.056986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1098/2118] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:34:12 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:34:13.060037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.218226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e34005-c572-47c2-b3fc-509536408860 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.229461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48615ab7-2eb3-4042-9ce7-871c42055cee admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.242856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.243876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.244353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.244887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.250364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.256552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.257206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.257993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.258461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.258845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.260988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.264142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.458528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1021/2119] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:34:13 2022] POST /identity/v3/users => generated 286 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:13.464543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.467774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1099/2120] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:34:13 2022] POST /identity/v3/users => generated 291 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:13.472107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.488689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fad43-2e0b-403e-afef-941aed52097c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.495278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.496191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.496693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.497273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.497991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e025e-bf7d-4da2-83fd-9b254dd2b583 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.498392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.501035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.519249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1022/2121] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:13.524133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.524879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.525308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.525599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.526275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.527907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.535739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.563234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c509-a588-46b9-a3be-cb0e416c583a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.572287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1100/2122] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:13.573928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.574618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.574906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.575187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.576235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.578163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.582121 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.589864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f32f-14ec-49a2-bb1a-3e8772ad97bd admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.601564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.606763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.606763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.606763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.606763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.606763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.623146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1101/2123] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:13.624130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1023/2124] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:13.632103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.633733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:13.649803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d99b0a-8d2d-4318-a4cb-8a7935587204 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.654655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d225d-6e28-446a-8590-e885a75c6eac admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:13.656893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e5786-59b9-4eb7-a8a4-e570a2e6a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.658093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5786-59b9-4eb7-a8a4-e570a2e6a0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.658581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5786-59b9-4eb7-a8a4-e570a2e6a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.659214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5786-59b9-4eb7-a8a4-e570a2e6a0b0 admin admin] PATH_INFO: `/v3/projects/e5a6da1ac55846679e4d87a2b1009ff1/users/6c341ec6ece04bd184d5afc192c72946/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.677853 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a58b4a-5e83-4df6-8a57-0450a1404a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:13.711754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58b4a-5e83-4df6-8a57-0450a1404a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.711754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58b4a-5e83-4df6-8a57-0450a1404a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.711754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58b4a-5e83-4df6-8a57-0450a1404a14 admin admin] PATH_INFO: `/v3/projects/ee9d450457a74e938f4968780a2d5b49/users/2e59243c1247449fa71afe5ff1c98b8e/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.713003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e5786-59b9-4eb7-a8a4-e570a2e6a0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a6da1ac55846679e4d87a2b1009ff1, user_id=6c341ec6ece04bd184d5afc192c72946, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.713003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e5786-59b9-4eb7-a8a4-e570a2e6a0b0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.713266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a58b4a-5e83-4df6-8a57-0450a1404a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9d450457a74e938f4968780a2d5b49, user_id=2e59243c1247449fa71afe5ff1c98b8e, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:13.713266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a58b4a-5e83-4df6-8a57-0450a1404a14 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:13.904906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1102/2125] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:34:13 2022] PUT /identity/v3/projects/e5a6da1ac55846679e4d87a2b1009ff1/users/6c341ec6ece04bd184d5afc192c72946/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:13.906252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1024/2126] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:34:13 2022] PUT /identity/v3/projects/ee9d450457a74e938f4968780a2d5b49/users/2e59243c1247449fa71afe5ff1c98b8e/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:13.913611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.913907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.914187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.916794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:13.917148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:13.917428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:13.939737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:13.942610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:13.950734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] MFA Rules not processed for user `2e59243c1247449fa71afe5ff1c98b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:13.959188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:14.011680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1103/2127] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:14.022480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:14.025132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:14.025694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1025/2128] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:34:14.052776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:14.055438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:14.138664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ff04a-47f1-4b9f-982d-032d37e9cbab None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:14.143073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6beed-be62-4b6c-881e-b4c36bfe8047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:14.143697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6beed-be62-4b6c-881e-b4c36bfe8047 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:14.143967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6beed-be62-4b6c-881e-b4c36bfe8047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:14.144420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6beed-be62-4b6c-881e-b4c36bfe8047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:14.148837 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85602064-eb71-4ff8-b300-033ac7d154b4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:14.158972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6beed-be62-4b6c-881e-b4c36bfe8047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:14.161236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6beed-be62-4b6c-881e-b4c36bfe8047 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:14.177150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:14.178330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:14.178625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:14.179910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:14.195261 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1104/2129] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:34:14.200051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:14.201814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:14.225377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1026/2130] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:15.908907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:16.838810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:17.152938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217230-3d07-4a29-83eb-fe0c15233bb9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:17.153858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217230-3d07-4a29-83eb-fe0c15233bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:17.154278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217230-3d07-4a29-83eb-fe0c15233bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:17.186985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2d217230-3d07-4a29-83eb-fe0c15233bb9 None None] MFA Rules not processed for user `6c341ec6ece04bd184d5afc192c72946`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:17.188174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2d217230-3d07-4a29-83eb-fe0c15233bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:17.294012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1105/2131] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:17.303553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:17.325148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581c7c-a404-47d5-8d8c-697eabc1f9b8 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:17.354123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c7231-ca84-40a6-817b-3ba60a1c5b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:17.354123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c7231-ca84-40a6-817b-3ba60a1c5b92 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:17.354123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c7231-ca84-40a6-817b-3ba60a1c5b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:17.354556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c7231-ca84-40a6-817b-3ba60a1c5b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:17.369847 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c7231-ca84-40a6-817b-3ba60a1c5b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:17.371673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c7231-ca84-40a6-817b-3ba60a1c5b92 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:17.391309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1027/2132] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:17.498875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:17.499170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:17.499447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:17.524047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] MFA Rules not processed for user `2e59243c1247449fa71afe5ff1c98b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:17.528244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:17.548350 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1106/2133] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:34:18.244343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ca9f1-1848-472e-84ad-c1b5cbcfe88e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:18.245177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ca9f1-1848-472e-84ad-c1b5cbcfe88e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:18.245686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ca9f1-1848-472e-84ad-c1b5cbcfe88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:18.281927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-973ca9f1-1848-472e-84ad-c1b5cbcfe88e None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:18.284021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-973ca9f1-1848-472e-84ad-c1b5cbcfe88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:18.347812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1028/2134] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:18.407041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:18.409328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:18.552070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e76e-b413-4f8d-ba16-11c4d42a4e4d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:18.564425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:18.565247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:18.565527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:18.565847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:18.579911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:18.581592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:18.610302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1107/2135] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:34:20.653463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a20c-8d2f-41b9-8163-b105e2859a2b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:20.654720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a20c-8d2f-41b9-8163-b105e2859a2b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:20.655390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a20c-8d2f-41b9-8163-b105e2859a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:20.715294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4d91a20c-8d2f-41b9-8163-b105e2859a2b None None] MFA Rules not processed for user `6c341ec6ece04bd184d5afc192c72946`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:20.720844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4d91a20c-8d2f-41b9-8163-b105e2859a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:20.752171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1029/2136] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:21.606004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:23.554295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:24.158726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:24.163292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:24.184674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19419d9d-ea50-4d93-9820-f767375e16b6 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:24.190284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:24.191137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:24.191821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:24.192033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] PATH_INFO: `/v3/users/5b72ffcbfc254442bd8f63d2c5c81504` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:24.193576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b72ffcbfc254442bd8f63d2c5c81504)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:24.197141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:24.664158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b72ffcbfc254442bd8f63d2c5c81504'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:24.685391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b72ffcbfc254442bd8f63d2c5c81504'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:24.696961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b72ffcbfc254442bd8f63d2c5c81504'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:24.702779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b72ffcbfc254442bd8f63d2c5c81504'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:24.852316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b72ffcbfc254442bd8f63d2c5c81504'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:24.871543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1108/2137] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:34:24 2022] DELETE /identity/v3/users/5b72ffcbfc254442bd8f63d2c5c81504 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:24.872180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:24.873050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:24.873050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:24.912993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:24.914707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:25.023006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1030/2138] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:25.090405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:25.096536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:25.212214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a58607-e3f2-436b-a21e-3a25eb9e4a5e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:25.217591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3331ada-467f-4683-838c-f11f3fb6178b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:25.221439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3331ada-467f-4683-838c-f11f3fb6178b service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:25.221439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3331ada-467f-4683-838c-f11f3fb6178b service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:25.221439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3331ada-467f-4683-838c-f11f3fb6178b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:25.241593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3331ada-467f-4683-838c-f11f3fb6178b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:25.243568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3331ada-467f-4683-838c-f11f3fb6178b service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:25.258739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1109/2139] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:27.876435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:27.876435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:27.901509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9cb4e-a2bd-48b5-92e8-bcf5edf83f69 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:27.907654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:27.908376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:27.908744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:27.909110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] PATH_INFO: `/v3/projects/1788e8387ff3470b890e100b2e64ee2f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:27.910368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1788e8387ff3470b890e100b2e64ee2f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:27.917053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:28.314389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1788e8387ff3470b890e100b2e64ee2f', 'request_id': 'req-565b4243-bdc5-4228-a6db-62b0eebf465d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:28.507992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1788e8387ff3470b890e100b2e64ee2f', 'request_id': 'req-565b4243-bdc5-4228-a6db-62b0eebf465d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:28.524708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1788e8387ff3470b890e100b2e64ee2f', 'request_id': 'req-565b4243-bdc5-4228-a6db-62b0eebf465d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:28.553920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] The token cache is being invalidate because project 1788e8387ff3470b890e100b2e64ee2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:34:28.554384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:28.555197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-565b4243-bdc5-4228-a6db-62b0eebf465d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:28.561129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1031/2140] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:34:27 2022] DELETE /identity/v3/projects/1788e8387ff3470b890e100b2e64ee2f => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:28.562236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:28.562783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:28.562783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:28.585794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:28.587541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:28.662231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1110/2141] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:34:28.670462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:28.671001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:28.671443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:28.720123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:28.721536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:28.737568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1032/2142] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:28.741568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:28.763511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99db3-77de-4a37-923e-a2504db9b901 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:28.777187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:28.777828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:28.778115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:28.778389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:28.779087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:34:28.779376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:28.781075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:28.799273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1111/2143] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:34:28.800097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:28.820000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea4309-8558-4c25-b484-d1b26abf1077 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:28.824898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:28.825522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:28.825807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:28.826156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:28.826724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:28.833277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:28.980406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1033/2144] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:34:28 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:28.983511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:28.995503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5184-b6ee-4dd3-9c9f-3f39e9d5e4d8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:29.006809 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:29.095166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:29.095954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.096338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.096714 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.097501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:29.101687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:29.252480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1112/2145] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:34:28 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:34:29.256141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:29.269291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ff4a-54c5-4114-8886-2388af6d4804 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:29.275812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:29.278179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.284436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.284436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.284436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:29.284436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:29.299371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:29.300869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1034/2146] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:29.314005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012400-4f2a-4620-80c1-3e1275e43e87 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:29.325175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee749-3c78-49bd-a244-9140a706f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:29.326885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee749-3c78-49bd-a244-9140a706f993 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.327347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee749-3c78-49bd-a244-9140a706f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.327801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee749-3c78-49bd-a244-9140a706f993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.331162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee749-3c78-49bd-a244-9140a706f993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:29.333860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee749-3c78-49bd-a244-9140a706f993 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:29.360349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:29.371214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1113/2147] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:34:29.372498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705bb2-56d7-48c4-97c2-35b3dc6af08e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:29.380717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:29.381894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.382386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.382819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] PATH_INFO: `/v3/projects/b77abf1720cf4dffbc83c9774ac6716b/users/9d2df630ec6f448facc3eeb910c55fe6/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.407104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77abf1720cf4dffbc83c9774ac6716b, user_id=9d2df630ec6f448facc3eeb910c55fe6, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:29.415168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:29.510325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1035/2148] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:34:29 2022] PUT /identity/v3/projects/b77abf1720cf4dffbc83c9774ac6716b/users/9d2df630ec6f448facc3eeb910c55fe6/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:29.521612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.522653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.522653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.662819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] MFA Rules not processed for user `9d2df630ec6f448facc3eeb910c55fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:29.667499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:29.798423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1114/2149] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:29.807212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:29.810455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:29.914189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c292-6d06-4c09-8e2c-0a68f03a5f2c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:29.918298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba284eb-c11e-439e-934b-1b4159916165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:29.919610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba284eb-c11e-439e-934b-1b4159916165 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.919610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba284eb-c11e-439e-934b-1b4159916165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.919610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba284eb-c11e-439e-934b-1b4159916165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.931570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba284eb-c11e-439e-934b-1b4159916165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:29.933046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba284eb-c11e-439e-934b-1b4159916165 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:29.951406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1036/2150] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:30.159975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:31.765214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:32.870098 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:38.045558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:38.125846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8cf44-5ff2-472a-9188-6a13e7277e20 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:38.132075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:38.132733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:38.133043 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:38.133317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] PATH_INFO: `/v3/users/9d2df630ec6f448facc3eeb910c55fe6` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:38.134492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2df630ec6f448facc3eeb910c55fe6)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:38.137149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:38.143291 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:38.340321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2df630ec6f448facc3eeb910c55fe6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:38.353144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2df630ec6f448facc3eeb910c55fe6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:38.361301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2df630ec6f448facc3eeb910c55fe6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:38.361865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2df630ec6f448facc3eeb910c55fe6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:38.433015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2df630ec6f448facc3eeb910c55fe6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:38.440148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1115/2151] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:34:38 2022] DELETE /identity/v3/users/9d2df630ec6f448facc3eeb910c55fe6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:38.444697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:38.445200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:38.445432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:38.464827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:38.466245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:38.553060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1037/2152] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:34:38.559414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:38.564160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:38.626157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f3d8-d68c-49c1-8167-9dab0e06194c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:38.633122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425df0-4240-4134-855d-8d6b31706075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:38.633122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425df0-4240-4134-855d-8d6b31706075 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:38.633122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425df0-4240-4134-855d-8d6b31706075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:38.633122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425df0-4240-4134-855d-8d6b31706075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:38.640862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425df0-4240-4134-855d-8d6b31706075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:38.642321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425df0-4240-4134-855d-8d6b31706075 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:38.653227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1116/2153] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:39.275215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:39.277641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:39.291826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f7737-8ae2-4d2c-8e7b-5626463507f7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:39.299004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:39.299909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:39.300242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:39.300585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] PATH_INFO: `/v3/projects/b77abf1720cf4dffbc83c9774ac6716b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:39.302652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77abf1720cf4dffbc83c9774ac6716b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:39.305476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:39.464323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77abf1720cf4dffbc83c9774ac6716b', 'request_id': 'req-fc912d80-5e01-4649-8ee5-945be5764837'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:39.615876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77abf1720cf4dffbc83c9774ac6716b', 'request_id': 'req-fc912d80-5e01-4649-8ee5-945be5764837'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:39.623409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77abf1720cf4dffbc83c9774ac6716b', 'request_id': 'req-fc912d80-5e01-4649-8ee5-945be5764837'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:39.635580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] The token cache is being invalidate because project b77abf1720cf4dffbc83c9774ac6716b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:34:39.635878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:39.646309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fc912d80-5e01-4649-8ee5-945be5764837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:34:39.646309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1038/2154] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:34:39 2022] DELETE /identity/v3/projects/b77abf1720cf4dffbc83c9774ac6716b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:34:44.574889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ecd2d-57c8-43a4-9a18-e785b2814bdf None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:44.575435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ecd2d-57c8-43a4-9a18-e785b2814bdf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:44.575618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ecd2d-57c8-43a4-9a18-e785b2814bdf None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:44.577096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1117/2155] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:34:44.588429 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:44.588998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:44.589425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:44.622964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:44.623136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:44.649571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ecd2d-57c8-43a4-9a18-e785b2814bdf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:44.651490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d94ecd2d-57c8-43a4-9a18-e785b2814bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:44.717272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:44.765519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ecd2d-57c8-43a4-9a18-e785b2814bdf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:44.767356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1039/2156] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:44.775342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:44.776040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:44.777530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:44.778564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:44.779182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:44.781098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:44.783367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:44.805865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:44.807564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376637-ab81-4980-88d0-90715ee3e258 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:44.826226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1118/2157] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:34:44.884881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f62cae-b550-43a0-9e40-7aa5c771a19b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:44.889375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e73a1-c109-4dc5-a509-b38b223ab397 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:44.890056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e73a1-c109-4dc5-a509-b38b223ab397 service glance] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:44.890359 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e73a1-c109-4dc5-a509-b38b223ab397 service glance] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:44.890634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e73a1-c109-4dc5-a509-b38b223ab397 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:44.907832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e73a1-c109-4dc5-a509-b38b223ab397 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:44.910319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e73a1-c109-4dc5-a509-b38b223ab397 service glance] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:44.938785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1040/2158] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:34:45.206347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429b840-6e7e-42ea-be9a-d439cf76fba0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:45.207048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429b840-6e7e-42ea-be9a-d439cf76fba0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:45.207394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429b840-6e7e-42ea-be9a-d439cf76fba0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:45.208869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1119/2159] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:34:45.214736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb001-dc63-469a-ab8e-e0274f3eb92d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:45.215055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb001-dc63-469a-ab8e-e0274f3eb92d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:45.215335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb001-dc63-469a-ab8e-e0274f3eb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:45.241784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c9dbb001-dc63-469a-ab8e-e0274f3eb92d None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:45.270467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c9dbb001-dc63-469a-ab8e-e0274f3eb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:45.295133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1041/2160] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:45.308394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429b840-6e7e-42ea-be9a-d439cf76fba0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:45.310414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8429b840-6e7e-42ea-be9a-d439cf76fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:45.323267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429b840-6e7e-42ea-be9a-d439cf76fba0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:45.326980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c520a-36d6-48e5-8e98-27f7e42feebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:45.327580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c520a-36d6-48e5-8e98-27f7e42feebe service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:45.327861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c520a-36d6-48e5-8e98-27f7e42feebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:45.328138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c520a-36d6-48e5-8e98-27f7e42feebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:45.335426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c520a-36d6-48e5-8e98-27f7e42feebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:45.336930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c520a-36d6-48e5-8e98-27f7e42feebe service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:45.345571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1120/2161] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:45.438301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934810-54a8-4c43-9edc-6db492008efd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:45.438301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934810-54a8-4c43-9edc-6db492008efd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:45.438301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934810-54a8-4c43-9edc-6db492008efd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:45.438301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1042/2162] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:34:45.439475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68106e9f-a068-4e60-8fc9-2eaa00be112b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:45.439763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68106e9f-a068-4e60-8fc9-2eaa00be112b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:45.440070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68106e9f-a068-4e60-8fc9-2eaa00be112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:45.449684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:45.461247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-68106e9f-a068-4e60-8fc9-2eaa00be112b None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:45.462482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-68106e9f-a068-4e60-8fc9-2eaa00be112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:45.472160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1121/2163] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:45.484080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934810-54a8-4c43-9edc-6db492008efd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:45.495699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934810-54a8-4c43-9edc-6db492008efd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:45.499951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ef346-1659-4e14-8967-1e46ece5c10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:45.500709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef346-1659-4e14-8967-1e46ece5c10d service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:45.501027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef346-1659-4e14-8967-1e46ece5c10d service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:45.501306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef346-1659-4e14-8967-1e46ece5c10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:45.515485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ef346-1659-4e14-8967-1e46ece5c10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:45.515485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ef346-1659-4e14-8967-1e46ece5c10d service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:45.529742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1043/2164] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:55.571664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:55.571664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:55.571664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:55.602308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] MFA Rules not processed for user `a7e527a5681648ac84b81415edf42256`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:55.602308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:55.680304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1122/2165] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:56.701145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ef91-ee21-4229-bc27-1655d924ae14 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:56.701653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ef91-ee21-4229-bc27-1655d924ae14 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:56.701749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ef91-ee21-4229-bc27-1655d924ae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:56.724251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1c94ef91-ee21-4229-bc27-1655d924ae14 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:56.725498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1c94ef91-ee21-4229-bc27-1655d924ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:56.795318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1044/2166] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:56.813313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:56.816529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:56.897255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb95a8f-0aa4-480f-b1f1-246617f441fa None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:56.902722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:56.903336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:56.903625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:56.903900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:56.912608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:56.914245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:56.922293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1123/2167] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:05.232039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a525c-9bc5-4288-9338-4d7d7c37b50e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:05.232643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a525c-9bc5-4288-9338-4d7d7c37b50e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:05.232643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a525c-9bc5-4288-9338-4d7d7c37b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:05.257335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f28a525c-9bc5-4288-9338-4d7d7c37b50e None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:05.258919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f28a525c-9bc5-4288-9338-4d7d7c37b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:05.266598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1045/2168] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:05.280545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:05.311996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b77df-d3d9-4474-80c0-d4048a8cedd4 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:05.318833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:05.319609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:05.319961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:05.320678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:05.329909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:05.337283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:05.347023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1124/2169] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:06.452456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d1d8-98b9-4089-8523-4af36ed4d23d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:06.453635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d1d8-98b9-4089-8523-4af36ed4d23d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:06.454478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d1d8-98b9-4089-8523-4af36ed4d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:06.481361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9de0d1d8-98b9-4089-8523-4af36ed4d23d None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:06.483299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9de0d1d8-98b9-4089-8523-4af36ed4d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:06.493612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1046/2170] 10.222.0.76 () {58 vars in 967 bytes} [Wed Aug 31 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:06.509061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:06.521985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a000ef-9718-4a94-9411-52079acb5893 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:06.534412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:06.534946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:06.535577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:06.536024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:06.549187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:06.554418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:06.567449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1125/2171] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:07.479327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b9489-8be8-4186-8491-0776ce11e278 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:07.479930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b9489-8be8-4186-8491-0776ce11e278 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:07.480052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b9489-8be8-4186-8491-0776ce11e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:07.500402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-fc8b9489-8be8-4186-8491-0776ce11e278 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:07.506627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fc8b9489-8be8-4186-8491-0776ce11e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:07.509025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1047/2172] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:35:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:07.522434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:07.533562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a93b9-0195-4e1f-837f-2277576c7762 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:07.539709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:07.540524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:07.541030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:07.541605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:07.551659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:07.553363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:07.562778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1126/2173] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:08.305046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:08.305333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:08.305610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:08.324730 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:08.325941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:08.333774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1048/2174] 10.222.0.76 () {58 vars in 967 bytes} [Wed Aug 31 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:08.345812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:08.356220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9ef8-45ee-4abe-b5dd-74f3064a1765 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:08.361408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bf22d-ed27-419c-8b30-87b6f9656c97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:08.362018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf22d-ed27-419c-8b30-87b6f9656c97 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:08.362294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf22d-ed27-419c-8b30-87b6f9656c97 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:08.362566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf22d-ed27-419c-8b30-87b6f9656c97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:08.371482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bf22d-ed27-419c-8b30-87b6f9656c97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:08.373149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bf22d-ed27-419c-8b30-87b6f9656c97 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:08.382109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1127/2175] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:11.271940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:11.273707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:11.280014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:11.342345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83e2c2-4c5c-4f1f-9397-7b38f9bf4ebe None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:11.347054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:11.347714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:11.348002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:11.348360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] PATH_INFO: `/v3/users/2e59243c1247449fa71afe5ff1c98b8e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:11.350269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e59243c1247449fa71afe5ff1c98b8e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:11.351592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:11.589591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e59243c1247449fa71afe5ff1c98b8e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:11.590254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e59243c1247449fa71afe5ff1c98b8e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:11.620533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e59243c1247449fa71afe5ff1c98b8e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:11.629390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e59243c1247449fa71afe5ff1c98b8e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:11.630497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e59243c1247449fa71afe5ff1c98b8e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:11.729162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1049/2176] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:11 2022] DELETE /identity/v3/users/2e59243c1247449fa71afe5ff1c98b8e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:11.733747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:11.737608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:11.737608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:11.754955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:11.756345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:11.795460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:11.822390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1128/2177] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:11.833561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:11.835082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:11.897173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc727f1-15fd-4cb4-844e-f208d6da3192 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:11.901346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0947c0-12af-46b6-8d20-42ac15ade3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:11.902220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0947c0-12af-46b6-8d20-42ac15ade3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:11.902723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0947c0-12af-46b6-8d20-42ac15ade3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:11.903199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0947c0-12af-46b6-8d20-42ac15ade3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:11.914042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0947c0-12af-46b6-8d20-42ac15ade3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:11.915515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0947c0-12af-46b6-8d20-42ac15ade3f1 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:11.928641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1050/2178] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:12.273911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:12.275358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:12.288610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f14ad-5f7c-4ee7-af18-373ec68f2e16 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:12.294041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:12.294700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:12.295448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:12.295448 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] PATH_INFO: `/v3/projects/ee9d450457a74e938f4968780a2d5b49` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:12.296915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9d450457a74e938f4968780a2d5b49)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:12.299445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:12.514101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9d450457a74e938f4968780a2d5b49', 'request_id': 'req-c4d6cca0-f617-4210-b175-06222bf52943'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:12.603331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9d450457a74e938f4968780a2d5b49', 'request_id': 'req-c4d6cca0-f617-4210-b175-06222bf52943'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:12.610445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9d450457a74e938f4968780a2d5b49', 'request_id': 'req-c4d6cca0-f617-4210-b175-06222bf52943'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:12.622317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] The token cache is being invalidate because project ee9d450457a74e938f4968780a2d5b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:12.622721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:12.623434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:12.625294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1129/2179] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:12 2022] DELETE /identity/v3/projects/ee9d450457a74e938f4968780a2d5b49 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:18.656131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164496-306b-4d58-90fc-f34ff3a988b0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:18.656595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164496-306b-4d58-90fc-f34ff3a988b0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:18.656697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164496-306b-4d58-90fc-f34ff3a988b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:18.677300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-07164496-306b-4d58-90fc-f34ff3a988b0 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:18.678510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-07164496-306b-4d58-90fc-f34ff3a988b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:18.698626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:18.745893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1051/2180] 10.222.0.76 () {58 vars in 967 bytes} [Wed Aug 31 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:18.771679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:18.773284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:18.853281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6cca0-f617-4210-b175-06222bf52943 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:18.858707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:18.859327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:18.859607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:18.859882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:18.869057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:18.870612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:18.880512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1130/2181] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:20.325738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844fabe-dec1-4a2c-8f47-ee840a6c3702 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:20.326277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844fabe-dec1-4a2c-8f47-ee840a6c3702 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:20.326397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844fabe-dec1-4a2c-8f47-ee840a6c3702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:20.346762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9844fabe-dec1-4a2c-8f47-ee840a6c3702 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:20.348005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9844fabe-dec1-4a2c-8f47-ee840a6c3702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:20.407740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1052/2182] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:20.433215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:20.434648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:20.491746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:20.512403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef00a-becf-44e9-8176-bb417dd677cf service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:20.517995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:20.519475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:20.519757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:20.520033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:20.528385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:20.530012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:20.540119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1131/2183] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:25.816525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5b2f6-a1d2-47f6-9e5b-d8394ea712bf None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:25.819106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5b2f6-a1d2-47f6-9e5b-d8394ea712bf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:25.819106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5b2f6-a1d2-47f6-9e5b-d8394ea712bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:25.837499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-11f5b2f6-a1d2-47f6-9e5b-d8394ea712bf None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:25.838692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-11f5b2f6-a1d2-47f6-9e5b-d8394ea712bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:25.847273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1053/2184] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:25.870598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:25.881860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9d7ba-2990-4ae4-b889-05158d5856fc service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:25.887789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:25.888400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:25.888683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:25.889007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:25.898635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:25.902064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:25.910812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1132/2185] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:35.111766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81216815-c665-4676-a5aa-7f29572481f5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:35.112354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81216815-c665-4676-a5aa-7f29572481f5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:35.112354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81216815-c665-4676-a5aa-7f29572481f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:35.148554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-81216815-c665-4676-a5aa-7f29572481f5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:35.150687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-81216815-c665-4676-a5aa-7f29572481f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:35.162406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1054/2186] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:35.183249 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:35.195397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025a6b-53e6-4653-921f-d6321b2f6979 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:35.202447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:35.203062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:35.203343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:35.203618 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:35.213489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:35.231296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:35.231296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1133/2187] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:39.680474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe7dd-77d6-48f0-a0ab-853c52a29b04 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.681364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe7dd-77d6-48f0-a0ab-853c52a29b04 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.681653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe7dd-77d6-48f0-a0ab-853c52a29b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.702399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-55dfe7dd-77d6-48f0-a0ab-853c52a29b04 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:39.703716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-55dfe7dd-77d6-48f0-a0ab-853c52a29b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:39.714423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1055/2188] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:39.739036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.758000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0efea-cef4-47ea-b02d-2d10369d045d service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.768578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.769244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.769530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.769806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.792321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.792915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.809572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1134/2189] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:42.388185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a140b-e86f-411b-80e5-503e6c2f71b5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:42.388599 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a140b-e86f-411b-80e5-503e6c2f71b5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:42.388733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a140b-e86f-411b-80e5-503e6c2f71b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:42.409806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-927a140b-e86f-411b-80e5-503e6c2f71b5 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:42.411101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-927a140b-e86f-411b-80e5-503e6c2f71b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:42.418929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1056/2190] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:42.431106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:42.443396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77498-eb36-4df5-b59a-ac02407a8517 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:42.448487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bdd04-752f-4b45-a864-7f16e21887ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:42.449133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bdd04-752f-4b45-a864-7f16e21887ab service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:42.449419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bdd04-752f-4b45-a864-7f16e21887ab service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:42.449699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bdd04-752f-4b45-a864-7f16e21887ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:42.458009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bdd04-752f-4b45-a864-7f16e21887ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:42.460215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bdd04-752f-4b45-a864-7f16e21887ab service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:42.468282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1135/2191] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:43.246673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.247282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.247561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.270394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] MFA Rules not processed for user `bec99c3414d44b85981e0122b0b4aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:43.271795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:43.334784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1057/2192] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:47.125145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b166c-6ae1-4362-98fe-103a0ef360d7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:47.125665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b166c-6ae1-4362-98fe-103a0ef360d7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:47.125815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b166c-6ae1-4362-98fe-103a0ef360d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:47.159540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fa5b166c-6ae1-4362-98fe-103a0ef360d7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:47.161146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fa5b166c-6ae1-4362-98fe-103a0ef360d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:47.170888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1136/2193] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:47.197725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:47.199160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:47.225422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcaea5-303f-413e-99de-1a027ff05ae2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:47.231675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:47.232412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:47.232699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:47.233123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:47.245977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:47.248120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:47.261375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1058/2194] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:51.578955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d703-f70c-4a0a-95cd-f4f052db21e5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:51.578955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d703-f70c-4a0a-95cd-f4f052db21e5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:51.578955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d703-f70c-4a0a-95cd-f4f052db21e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:51.586365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=38 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:51.606132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9879d703-f70c-4a0a-95cd-f4f052db21e5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:51.608215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9879d703-f70c-4a0a-95cd-f4f052db21e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:51.620319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1137/2195] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:51.647559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:51.657422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:51.667515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f396b6-c94a-4be7-b8ab-39bcb89d7570 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:51.714492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:51.715134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:51.718062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:51.730246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:51.743887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:51.746014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:51.791480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1059/2196] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:01.135456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58ec7-732d-46a7-bde7-e542b65ab637 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:01.135929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58ec7-732d-46a7-bde7-e542b65ab637 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:01.136048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58ec7-732d-46a7-bde7-e542b65ab637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:01.155549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4ee58ec7-732d-46a7-bde7-e542b65ab637 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:01.156941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4ee58ec7-732d-46a7-bde7-e542b65ab637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:01.164177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1138/2197] 10.222.0.76 () {58 vars in 967 bytes} [Wed Aug 31 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:01.176814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:01.188545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4105-4446-4d2f-9837-3942d0b47103 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:01.194260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7146-906d-4c78-b3eb-8b68bd592e1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:01.194867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7146-906d-4c78-b3eb-8b68bd592e1b service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:01.195142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7146-906d-4c78-b3eb-8b68bd592e1b service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:01.195423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7146-906d-4c78-b3eb-8b68bd592e1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:01.205112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed7146-906d-4c78-b3eb-8b68bd592e1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:01.206764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed7146-906d-4c78-b3eb-8b68bd592e1b service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:01.215038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1060/2198] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:04.958844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd0463-6929-4baf-bcea-de9fe23aec7f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:04.959423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd0463-6929-4baf-bcea-de9fe23aec7f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:04.959423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd0463-6929-4baf-bcea-de9fe23aec7f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:04.960792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1139/2199] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:36:04.972152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:04.975904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:04.975904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.002173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] MFA Rules not processed for user `79c69df95a434fdeb5737455ba226320`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:05.003414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:05.074394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1061/2200] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:05.085932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd0463-6929-4baf-bcea-de9fe23aec7f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:05.091280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-45bd0463-6929-4baf-bcea-de9fe23aec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:05.109237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd0463-6929-4baf-bcea-de9fe23aec7f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:05.114483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:05.115360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:05.115642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:05.115923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.125143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:05.126932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.152632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1140/2201] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:05.170440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:05.173283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:05.199224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4476e7-6cdc-486a-aace-d50b1040beca None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:05.205456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:05.206156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:05.206439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:05.206885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] PATH_INFO: `/v3/users/a7e527a5681648ac84b81415edf42256` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.209066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e527a5681648ac84b81415edf42256)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:05.211790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.570892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e527a5681648ac84b81415edf42256'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:05.572156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e527a5681648ac84b81415edf42256'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:05.611458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e527a5681648ac84b81415edf42256'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:05.619834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e527a5681648ac84b81415edf42256'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:05.621396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e102a891-d7d8-4190-a30a-111c68764ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e527a5681648ac84b81415edf42256'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:05.728392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1062/2202] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:36:05 2022] DELETE /identity/v3/users/a7e527a5681648ac84b81415edf42256 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:06.051812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:06.065119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f70b-f356-42b9-964e-a6e4346d4338 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:06.147936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:06.148996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:06.149307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:06.149584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] PATH_INFO: `/v3/projects/5666c343a15e4ac48b67031d9c702b8b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:06.150729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5666c343a15e4ac48b67031d9c702b8b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:06.152642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:06.267801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5666c343a15e4ac48b67031d9c702b8b', 'request_id': 'req-c43f25e3-45fe-422b-afc5-b3e29092498b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:06.396758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5666c343a15e4ac48b67031d9c702b8b', 'request_id': 'req-c43f25e3-45fe-422b-afc5-b3e29092498b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:06.403752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5666c343a15e4ac48b67031d9c702b8b', 'request_id': 'req-c43f25e3-45fe-422b-afc5-b3e29092498b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:06.415123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] The token cache is being invalidate because project 5666c343a15e4ac48b67031d9c702b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:36:06.415416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:06.416075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c43f25e3-45fe-422b-afc5-b3e29092498b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:06.417611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1141/2203] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:36:06 2022] DELETE /identity/v3/projects/5666c343a15e4ac48b67031d9c702b8b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:06.422961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:06.423509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:06.423606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:06.444664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:06.445968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:06.495166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:06.535304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1063/2204] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:06.544892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:06.546936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:06.547259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:06.571738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:06.573911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:06.583912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1142/2205] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:06.586156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:06.597003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1caa3-55b4-4229-883a-062b3d131a1d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:06.602471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:06.603094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:06.603376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:06.603850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:06.604535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:36:06.604867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:06.606598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:06.619321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1064/2206] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:36:06.624061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:06.633976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623a3de-c268-4955-a9f8-bcc391ba95d9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:06.639705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:06.640312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:06.640718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:06.641221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:06.642994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:06.644722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:06.816407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1143/2207] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:36:06 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:36:06.820138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:06.830942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b3820-26e1-4a48-b984-deae479ff872 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:06.887507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:06.888041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:06.888327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:06.888601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:06.889286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:06.891222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:07.031477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1065/2208] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:36:06 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:36:07.036422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:07.046691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00a11-ef97-47e5-9586-dd4eef91b583 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:07.052143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:07.052959 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.053135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.053410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.054056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:07.055660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:07.065869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1144/2209] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:36:07.097453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:07.108436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbd3da-56f1-43b2-938b-f24139209b4e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:07.113910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067decc2-94a0-47aa-87d2-5fb628e8fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:07.114512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067decc2-94a0-47aa-87d2-5fb628e8fb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.114792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067decc2-94a0-47aa-87d2-5fb628e8fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.115066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067decc2-94a0-47aa-87d2-5fb628e8fb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.115719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067decc2-94a0-47aa-87d2-5fb628e8fb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:07.117344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067decc2-94a0-47aa-87d2-5fb628e8fb3d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:07.128882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1066/2210] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:36:07.133191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:07.144157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a565e6-42f2-4dc5-85e7-f9dd406df7d6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:07.148766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:07.149546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.149833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.150148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] PATH_INFO: `/v3/projects/1dc2d9cbb760404dafa4282865bb9b11/users/15d9acdceb67456591d0ed24ed4e7fc1/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.165184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc2d9cbb760404dafa4282865bb9b11, user_id=15d9acdceb67456591d0ed24ed4e7fc1, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:07.167823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:07.301362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1145/2211] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:36:07 2022] PUT /identity/v3/projects/1dc2d9cbb760404dafa4282865bb9b11/users/15d9acdceb67456591d0ed24ed4e7fc1/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:07.306408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc341-3ba5-4fbc-8f8c-c26299937611 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.306955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc341-3ba5-4fbc-8f8c-c26299937611 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.307435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc341-3ba5-4fbc-8f8c-c26299937611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.329437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e91bc341-3ba5-4fbc-8f8c-c26299937611 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:07.330686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e91bc341-3ba5-4fbc-8f8c-c26299937611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:07.393135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1067/2212] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:07.402675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:07.404456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:07.409849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:07.462002 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211ad0-d7d3-400e-bd9e-a959cedd352f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:07.465745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5521d0-0a90-4da3-8da6-6d07a46deace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:07.466347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5521d0-0a90-4da3-8da6-6d07a46deace service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.466627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5521d0-0a90-4da3-8da6-6d07a46deace service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.466902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5521d0-0a90-4da3-8da6-6d07a46deace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.476283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5521d0-0a90-4da3-8da6-6d07a46deace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:07.477747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5521d0-0a90-4da3-8da6-6d07a46deace service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:07.487692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1146/2213] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:10.380424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:10.380972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:10.381056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:10.401597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] MFA Rules not processed for user `69684b11ca0c4af08d081da48b898115`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:10.402852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:10.458427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:10.493366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1068/2214] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:15.817849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6cb0-3fec-4202-aaa6-acbcec699dec None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:15.818474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6cb0-3fec-4202-aaa6-acbcec699dec None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:15.818474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6cb0-3fec-4202-aaa6-acbcec699dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:15.872240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-acbf6cb0-3fec-4202-aaa6-acbcec699dec None None] MFA Rules not processed for user `15d9acdceb67456591d0ed24ed4e7fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:15.873919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-acbf6cb0-3fec-4202-aaa6-acbcec699dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:15.984107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1147/2215] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:15.989212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:16.001604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5117ca-a839-470e-b33b-2e550092fcf1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:16.008569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:16.009499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.010010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.010467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.011513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:16.015202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:16.131189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.132008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.132008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.136841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1069/2216] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:36:15 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:36:16.139745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:16.155427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] MFA Rules not processed for user `6c341ec6ece04bd184d5afc192c72946`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:16.156777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:16.212388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a36eca-e8a9-43fe-9616-8f2dcca6b826 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:16.217436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:16.218184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.218184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.218668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.219326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:16.221876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:16.223908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1148/2217] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:16.340006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1070/2218] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:36:16 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:36:16.343883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:16.355633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285756-8868-4402-b3e6-9610b444d693 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:16.363312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:16.363958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.364246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.364530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.365236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:16.366957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:16.394026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1149/2219] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:36:16.394182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:16.395384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d742cc-7b3f-4939-9477-4ccfba3ff104 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:16.400343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:16.401037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.401322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.401606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] PATH_INFO: `/v3/projects/2d790b44d60e4bddad6661ef4eba1ecb/users/a0d6de2005b84f48839cb2b9905fad83/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.424063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d790b44d60e4bddad6661ef4eba1ecb, user_id=a0d6de2005b84f48839cb2b9905fad83, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:16.427431 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:16.568547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1071/2220] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:36:16 2022] PUT /identity/v3/projects/2d790b44d60e4bddad6661ef4eba1ecb/users/a0d6de2005b84f48839cb2b9905fad83/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:16.571031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:16.586887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca424-a61c-4623-b770-07f9f9431ee5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:16.616532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:16.683524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabc7e4-06a4-455e-abb7-2646c7b7f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:16.686281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc7e4-06a4-455e-abb7-2646c7b7f566 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.686281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc7e4-06a4-455e-abb7-2646c7b7f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.686281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc7e4-06a4-455e-abb7-2646c7b7f566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.686281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabc7e4-06a4-455e-abb7-2646c7b7f566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:16.687710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabc7e4-06a4-455e-abb7-2646c7b7f566 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:16.701848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1150/2221] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:36:16.707217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:16.722597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be217c9-f1ef-4dc1-b1c8-b87fcf9daf8a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:16.728998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe8bfe-257b-4331-b353-82dd10d977a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:16.729749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe8bfe-257b-4331-b353-82dd10d977a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:16.734067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe8bfe-257b-4331-b353-82dd10d977a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:16.734067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe8bfe-257b-4331-b353-82dd10d977a9 admin admin] PATH_INFO: `/v3/projects/2d790b44d60e4bddad6661ef4eba1ecb/users/a0d6de2005b84f48839cb2b9905fad83/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:16.734067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe8bfe-257b-4331-b353-82dd10d977a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d790b44d60e4bddad6661ef4eba1ecb, user_id=a0d6de2005b84f48839cb2b9905fad83, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:16.734925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe8bfe-257b-4331-b353-82dd10d977a9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:16.747489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1072/2222] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:36:16 2022] PUT /identity/v3/projects/2d790b44d60e4bddad6661ef4eba1ecb/users/a0d6de2005b84f48839cb2b9905fad83/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:24.987561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:24.988330 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:24.988604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:25.010126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] MFA Rules not processed for user `76a42ecd5a0b4058ab1192e8a019e087`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:25.011398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:25.108358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1151/2223] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:36:26.743206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=55,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:26.784442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10172f-166c-4c81-9994-6892fe5d24bb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:26.784736 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10172f-166c-4c81-9994-6892fe5d24bb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:26.785078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10172f-166c-4c81-9994-6892fe5d24bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:26.813833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0c10172f-166c-4c81-9994-6892fe5d24bb None None] MFA Rules not processed for user `a0d6de2005b84f48839cb2b9905fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:26.815033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0c10172f-166c-4c81-9994-6892fe5d24bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:26.885804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1073/2224] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:26.906314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:26.906314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:26.983525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d925a-fabc-4758-a616-018be4a0343e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:26.988316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '011b9ddf05d14d75aaa67fb395ec7312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:26.989163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:26.989548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:26.989930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:27.064142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:27.065623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:27.075157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1152/2225] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:27.575339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:27.575715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:27.576067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:27.596164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:27.597451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:27.661703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1074/2226] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:27.684576 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:27.686210 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:27.718553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:27.766411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac04a-bf9d-46f9-ae0d-04d7959dc840 service glance] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:27.771859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786c9b7-80e8-4d2c-9760-cdcc907097df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:27.772623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786c9b7-80e8-4d2c-9760-cdcc907097df service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:27.773026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786c9b7-80e8-4d2c-9760-cdcc907097df service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:27.773380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786c9b7-80e8-4d2c-9760-cdcc907097df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:27.783215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786c9b7-80e8-4d2c-9760-cdcc907097df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:27.785066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786c9b7-80e8-4d2c-9760-cdcc907097df service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:27.794023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1153/2227] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:38.563640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:38.565505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:38.650735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f66137-7b05-4cf5-b105-3fd715854317 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:38.654878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:38.655361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:38.655699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:38.655980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:38.660075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:38.710513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:38.744202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:38.746772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:38.766963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1075/2228] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:36:38.893832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=21 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:39.269918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d1df-45ed-431e-9e60-4aedf16cceb9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:39.269918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d1df-45ed-431e-9e60-4aedf16cceb9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:39.270207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d1df-45ed-431e-9e60-4aedf16cceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:39.290429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8768d1df-45ed-431e-9e60-4aedf16cceb9 None None] MFA Rules not processed for user `15d9acdceb67456591d0ed24ed4e7fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:39.291661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8768d1df-45ed-431e-9e60-4aedf16cceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:39.299441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1154/2229] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:39.548883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:39.578945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413e78-d20e-451e-84fc-783503c9b54c service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:39.584386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:39.585119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:39.585404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:39.585680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:39.588228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:39.604881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:39.606507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:39.619840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1076/2230] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:36:44.122400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640985-813c-405c-9ef5-49689ea2f36d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:44.122914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640985-813c-405c-9ef5-49689ea2f36d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:44.123370 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640985-813c-405c-9ef5-49689ea2f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:44.148712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a8640985-813c-405c-9ef5-49689ea2f36d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:44.150003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a8640985-813c-405c-9ef5-49689ea2f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:44.231360 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1155/2231] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:44.252758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:44.254447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:44.281095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d63c-6974-4d55-abbd-93d35de08959 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:44.303818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:44.304448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:44.304734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:44.305070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:44.315409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:44.317095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:44.329168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1077/2232] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:48.347433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a107d7-eb58-4c5a-b4c7-a7c593c7eb77 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:48.348305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a107d7-eb58-4c5a-b4c7-a7c593c7eb77 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:48.348305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a107d7-eb58-4c5a-b4c7-a7c593c7eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:48.373034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-39a107d7-eb58-4c5a-b4c7-a7c593c7eb77 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:48.374606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-39a107d7-eb58-4c5a-b4c7-a7c593c7eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:48.383268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1156/2233] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:36:48.398880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:48.411927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3be70-4ffe-4216-987d-45efdc95765f service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:48.418676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:48.419389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:48.419735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:48.420135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:48.434633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:48.436322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:48.445378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1078/2234] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:36:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:51.249795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c02c-3efb-434e-8a72-7b3ecd9753d8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:51.251089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c02c-3efb-434e-8a72-7b3ecd9753d8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:51.251682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c02c-3efb-434e-8a72-7b3ecd9753d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:51.278031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a3b3c02c-3efb-434e-8a72-7b3ecd9753d8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:51.280615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a3b3c02c-3efb-434e-8a72-7b3ecd9753d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:51.291883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1157/2235] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:36:51.327805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:51.342066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464627b-7df9-48a3-bf3f-c781a839ca6d service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:51.357167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:51.358500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:51.360041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:51.360586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:51.378675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:51.381985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:51.393793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1079/2236] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:53.832190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:53.832854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:53.833336 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:53.854131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] MFA Rules not processed for user `5d72d15d3d7848baaba2968bb4a16ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:53.855359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:53.932390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1158/2237] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:54.280842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:54.302224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b7e0-bd00-4ca1-b1f9-58861b7fd97b service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:54.306480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:54.307201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:54.307563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:54.307770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:54.309605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:54.321445 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:54.322766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:54.333203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1080/2238] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:36:55.112597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:55.116309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:55.218137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba3d1-db56-4a4b-be99-71c96866a4a1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:55.237395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:55.238189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:55.238454 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:55.238776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:55.241283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:55.257354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:55.258979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:55.271956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1159/2239] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:36:56.834603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:56.836524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:56.900169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeca08-1484-43e0-8c61-3b95a51754ca service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:56.904068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:56.905087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:56.905546 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:56.905912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:56.910597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:56.974300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:56.975746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:56.986184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1081/2240] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:58.965140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:58.993041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cbf1a-3f4f-4d70-bced-9b0f7f3be671 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:58.997192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:58.998015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:58.998583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:58.998784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:59.002105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:59.018996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:59.082447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:59.083908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:59.094825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1160/2241] 10.222.0.76 () {60 vars in 1396 bytes} [Wed Aug 31 19:36:58 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:00.153630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:00.155304 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:00.171922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a127-eabb-4423-98e1-5416f2c4bca2 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:00.178094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:00.178716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:00.178998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:00.179275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:00.181129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:00.192654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:00.194459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7486f-5224-45d2-a9b8-348378c906dd service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:00.204388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1082/2242] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:00.954606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:00.981368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a884be-a4f5-42b5-8a86-5fb4fa8cc58c service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:00.985609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:00.986553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:00.986887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:00.987112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:00.988995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:00.998955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:01.000917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:01.008884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1161/2243] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:37:02.302124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf7b96-abc9-424c-a665-1ce616bc6361 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:02.302657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf7b96-abc9-424c-a665-1ce616bc6361 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:02.302832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf7b96-abc9-424c-a665-1ce616bc6361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:02.318555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:02.326642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8adf7b96-abc9-424c-a665-1ce616bc6361 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:02.329561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8adf7b96-abc9-424c-a665-1ce616bc6361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:02.340615 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1083/2244] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:02.372790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:02.389216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9960b1-d032-4d72-8c81-f8ea5d9c400a service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:02.403056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83126781-420a-4f25-acfd-462df3896301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:02.404706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83126781-420a-4f25-acfd-462df3896301 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:02.405197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83126781-420a-4f25-acfd-462df3896301 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:02.405507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83126781-420a-4f25-acfd-462df3896301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:02.416235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83126781-420a-4f25-acfd-462df3896301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:02.418028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83126781-420a-4f25-acfd-462df3896301 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:02.430303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1162/2245] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:10.791320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:10.791907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:10.792486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:10.823813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:10.829603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:10.835312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1084/2246] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:37:10.861201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83126781-420a-4f25-acfd-462df3896301 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:10.875514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83126781-420a-4f25-acfd-462df3896301 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:10.878217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9729-d0fa-45a3-98e2-f6a8e918d975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:10.879127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9729-d0fa-45a3-98e2-f6a8e918d975 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:10.879648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9729-d0fa-45a3-98e2-f6a8e918d975 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:10.880133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9729-d0fa-45a3-98e2-f6a8e918d975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:10.895050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf9729-d0fa-45a3-98e2-f6a8e918d975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:10.896651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf9729-d0fa-45a3-98e2-f6a8e918d975 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:10.908541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1163/2247] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:18.193147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:18.204666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:18.205753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:18.206217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:18.218393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f17a0-9eab-47b0-9277-052566524878 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:18.228175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:18.229218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:18.229854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:18.230138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:18.230415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:18.231415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:18.232706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:18.240816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1164/2248] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 31 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:37:18.247322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:18.249338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61e376-02fd-4da5-b4ac-f68ca5ce4420 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:18.267989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:18.277406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1085/2249] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:37:18.285726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf846-482c-44fd-8920-1fec9ddd88af None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:18.293565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:18.294551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:18.295068 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:18.295859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:18.313468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:18.314161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:18.339867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1165/2250] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:28.257103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=9 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:28.320593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=48 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:28.703923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:28.704214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:28.704500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:28.723520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] MFA Rules not processed for user `bec99c3414d44b85981e0122b0b4aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:28.724725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:28.731551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1086/2251] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:29.061812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:29.071882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4eaec-1b5b-4021-bb91-3f90c6cec48f service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:29.075674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:29.076278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:29.076589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:29.076899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:29.078794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:29.088211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:29.089659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:29.097593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1166/2252] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:33.544464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:33.567152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36137a7-a9e9-4bab-9386-dc8818f9585a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:33.576363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:33.576989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:33.577777 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:33.578082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:33.580069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:33.593698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:33.595314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:33.605764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1087/2253] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:35.126868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:35.136235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121453-21b8-40e3-8488-3a411de04aec service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:35.141193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:35.150308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:35.150308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:35.150308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:35.151953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:35.153423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:35.163342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1167/2254] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:40.309773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:40.324477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd7fe-b3f7-478b-8115-7a618f22ef40 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:40.334718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:40.335817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:40.336473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:40.337353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:40.340495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:40.369986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:40.372111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:40.406029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1088/2255] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:37:43.616644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:43.638564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd5f43-8dc8-4c68-a162-f3df886798e4 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:43.650997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:43.651849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:43.652141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:43.652420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:43.654537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:43.670054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:43.671567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:43.685192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1168/2256] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:48.194607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:48.240415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6794e7-2960-4627-ab2b-a4d120afa90b service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:48.248284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:48.251696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:48.251696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:48.251696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:48.254008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:48.270330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:48.272177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:48.296277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1089/2257] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:49.466198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:49.468728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:49.572422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360450e-6b07-4d51-b83b-a293e87a1139 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:49.578263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:49.578906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:49.579183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:49.579459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] PATH_INFO: `/v3/users/69684b11ca0c4af08d081da48b898115` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:49.580656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69684b11ca0c4af08d081da48b898115)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:49.583101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:49.787371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69684b11ca0c4af08d081da48b898115'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:49.799681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69684b11ca0c4af08d081da48b898115'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:49.806474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69684b11ca0c4af08d081da48b898115'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:49.807167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69684b11ca0c4af08d081da48b898115'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:49.875727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-244f0f0a-f280-49ef-8fe5-e250892f0ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69684b11ca0c4af08d081da48b898115'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:49.884709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1169/2258] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:49 2022] DELETE /identity/v3/users/69684b11ca0c4af08d081da48b898115 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:50.214568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:50.270264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046387-29f6-4b72-babc-532dc1faa4b4 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:50.355922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:50.356603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:50.356956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:50.357283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] PATH_INFO: `/v3/projects/7ee49d8521194e41a5229fe104739d1b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:50.359041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee49d8521194e41a5229fe104739d1b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:50.361088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:50.552964 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee49d8521194e41a5229fe104739d1b', 'request_id': 'req-005a5394-efcc-45a6-a9c9-b4d1aeda9406'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:50.709681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee49d8521194e41a5229fe104739d1b', 'request_id': 'req-005a5394-efcc-45a6-a9c9-b4d1aeda9406'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:50.717366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee49d8521194e41a5229fe104739d1b', 'request_id': 'req-005a5394-efcc-45a6-a9c9-b4d1aeda9406'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:50.729527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] The token cache is being invalidate because project 7ee49d8521194e41a5229fe104739d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:50.729827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:50.730514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-005a5394-efcc-45a6-a9c9-b4d1aeda9406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:50.732028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1090/2259] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:50 2022] DELETE /identity/v3/projects/7ee49d8521194e41a5229fe104739d1b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:50.738159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:50.738736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:50.738736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:50.761911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:50.765695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:50.802683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:50.847874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1170/2260] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:37:50.856124 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:50.856415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:50.856685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:50.882858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:50.884085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:50.893548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1091/2261] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:50.898773 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:50.910823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e10f6-2a8e-4405-afc9-0e0279170e20 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:50.915758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:50.916362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:50.916643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:50.916953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:50.917608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:37:50.917909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:50.921201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:50.935883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1171/2262] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:37:50.940447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:50.950718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a9af1-5ca8-42ee-8ba5-f7e99792761f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:50.958390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:50.959038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:50.959582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:50.960689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:50.961293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:50.964462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:50.980696 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:51.075923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1092/2263] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:37:50 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:51.080996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.091992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd846-9ddb-40ce-ac10-f3e12356c118 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.163605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:51.164246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.165001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.165001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.166722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:51.167727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:51.294383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1172/2264] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:37:51 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:51.298822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.313437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020d8de-1c81-4b7f-a417-56ad92bc3648 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.319354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:51.320179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.320453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.320723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.321421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:51.323042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:51.349042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1093/2265] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:37:51.354888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.374139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb05615-7d9e-43ba-9f89-b69ac57b5290 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.382333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e0e33-8f67-4654-977b-cccc5c4026a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:51.383311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e0e33-8f67-4654-977b-cccc5c4026a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.383792 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e0e33-8f67-4654-977b-cccc5c4026a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.384271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e0e33-8f67-4654-977b-cccc5c4026a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.385476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e0e33-8f67-4654-977b-cccc5c4026a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:51.388602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e0e33-8f67-4654-977b-cccc5c4026a1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:51.412509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1173/2266] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:37:51.414361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.430988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c34ea-d0d3-4d32-a1f9-4b3882475f37 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.438248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:51.439018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.439357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.439634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] PATH_INFO: `/v3/projects/5ffd9007d7d04983af7a99a2ca9e4b8b/users/819f03dbba7b4e5f8afcb98130eb221b/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.461726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffd9007d7d04983af7a99a2ca9e4b8b, user_id=819f03dbba7b4e5f8afcb98130eb221b, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:51.466119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:51.561713 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1094/2267] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:51 2022] PUT /identity/v3/projects/5ffd9007d7d04983af7a99a2ca9e4b8b/users/819f03dbba7b4e5f8afcb98130eb221b/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:51.575325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.575939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.576521 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.615368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] MFA Rules not processed for user `819f03dbba7b4e5f8afcb98130eb221b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:51.617144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:51.710398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1174/2268] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:37:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:51.711860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.800727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41573a7-6d45-4626-b1f6-674310ae89d5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.808797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:51.809539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.809891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.810254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.811135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:51.813521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:51.934908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1095/2269] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:37:51 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:51.936954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.958270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf6d80-c857-4bb2-9429-3fd9d7a8e7cc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.995341 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:52.036460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:52.037766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.037766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.037766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.038345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.040299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.158523 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1175/2270] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:37:51 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:52.163255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:52.176013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a9b4-1cf2-4d1c-ab3c-ef0655c47c5a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:52.181215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:52.181939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.182226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.182500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.183196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.184878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.203520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1096/2271] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:52.205661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:52.221983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69530-42ab-446f-82d2-614c9ac533e5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:52.229199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:52.230110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.230537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.231005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] PATH_INFO: `/v3/projects/7cc473e6d7d547c6a3be67c73f5253d5/users/43cd8eb438324459818cda747388e42b/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.254203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc473e6d7d547c6a3be67c73f5253d5, user_id=43cd8eb438324459818cda747388e42b, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.257925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.370946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1176/2272] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:52 2022] PUT /identity/v3/projects/7cc473e6d7d547c6a3be67c73f5253d5/users/43cd8eb438324459818cda747388e42b/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:52.373005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:52.384331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f39a-258c-4119-bc16-9581185e1eea admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:52.463377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a5520-785c-4916-9045-ab97aba47529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:52.464406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5520-785c-4916-9045-ab97aba47529 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.464945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5520-785c-4916-9045-ab97aba47529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.465425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5520-785c-4916-9045-ab97aba47529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.466443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a5520-785c-4916-9045-ab97aba47529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.468907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a5520-785c-4916-9045-ab97aba47529 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.483362 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1097/2273] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:52.489541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:52.506797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c9980-804a-4910-8871-8c9dde46409b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:52.519109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:52.519109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.535348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.535348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] PATH_INFO: `/v3/projects/7cc473e6d7d547c6a3be67c73f5253d5/users/43cd8eb438324459818cda747388e42b/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.535348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc473e6d7d547c6a3be67c73f5253d5, user_id=43cd8eb438324459818cda747388e42b, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.535348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.566649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1177/2274] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:52 2022] PUT /identity/v3/projects/7cc473e6d7d547c6a3be67c73f5253d5/users/43cd8eb438324459818cda747388e42b/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:37:52.581195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.581195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.581671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.618734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] MFA Rules not processed for user `43cd8eb438324459818cda747388e42b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:52.620061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:52.636587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:52.728585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1098/2275] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:37:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:52.743138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:52.747821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:52.853420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff94d61-2e76-4226-a39a-351f26a39fe1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:52.857923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8ef6-524c-4424-9576-fcd8062cf67a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:52.858799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8ef6-524c-4424-9576-fcd8062cf67a service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:52.859223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8ef6-524c-4424-9576-fcd8062cf67a service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:52.859568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8ef6-524c-4424-9576-fcd8062cf67a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:52.870347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8ef6-524c-4424-9576-fcd8062cf67a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.872069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8ef6-524c-4424-9576-fcd8062cf67a service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.886306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1178/2276] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:53.153183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:53.171604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad70a3-bf2d-450a-bd0a-dcead3d88acc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:53.176319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:53.177122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:53.177448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:53.177724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:53.245963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:53.247497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:53.258330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1099/2277] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:57.624950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.625891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.626174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.657226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:57.658564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:57.775495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1179/2278] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:57.840361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.842419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:57.942120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7103714-3526-4203-a55f-b5eb87085a66 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.951224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164614c-54e7-459c-8cca-9f468b17251c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.952831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164614c-54e7-459c-8cca-9f468b17251c service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.953212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164614c-54e7-459c-8cca-9f468b17251c service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.953646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164614c-54e7-459c-8cca-9f468b17251c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.966708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164614c-54e7-459c-8cca-9f468b17251c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.969219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164614c-54e7-459c-8cca-9f468b17251c service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.983859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1100/2279] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:38:04.924895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:04.939185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:04.997015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f1a1-0cf4-4ac3-9344-b27aefe7c34d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:05.002463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:05.003107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:05.003390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:05.003662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] PATH_INFO: `/v3/users/819f03dbba7b4e5f8afcb98130eb221b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:05.005944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819f03dbba7b4e5f8afcb98130eb221b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:05.007926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:05.660797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819f03dbba7b4e5f8afcb98130eb221b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:05.690810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819f03dbba7b4e5f8afcb98130eb221b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:05.707197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819f03dbba7b4e5f8afcb98130eb221b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:05.708636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819f03dbba7b4e5f8afcb98130eb221b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:05.825296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819f03dbba7b4e5f8afcb98130eb221b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:05.840873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1180/2280] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:04 2022] DELETE /identity/v3/users/819f03dbba7b4e5f8afcb98130eb221b => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:05.858384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:05.860530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:05.860530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:05.887629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:05.889430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:05.966081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:05.971683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:05.974232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:06.019578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1101/2281] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:06.034242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:06.036470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:06.115094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c860d-246c-4483-8e06-c98d9751f7c5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:06.120654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:06.121613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:06.121922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:06.122155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] PATH_INFO: `/v3/users/6c341ec6ece04bd184d5afc192c72946` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:06.123942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c341ec6ece04bd184d5afc192c72946)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:06.126031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:06.171092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47146e-fee2-4f21-80c6-dfe044b23713 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:06.177793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:06.185038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:06.185038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:06.185038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:06.191749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:06.196503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:06.209946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1102/2282] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:06.437144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:06.458904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c341ec6ece04bd184d5afc192c72946'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:06.478807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c341ec6ece04bd184d5afc192c72946'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:06.497149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c341ec6ece04bd184d5afc192c72946'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:06.500219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c341ec6ece04bd184d5afc192c72946'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:06.676917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c341ec6ece04bd184d5afc192c72946'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:06.699541 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1181/2283] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:05 2022] DELETE /identity/v3/users/6c341ec6ece04bd184d5afc192c72946 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:06.876584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:06.878221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:06.914439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f96c-7b38-48de-a8bc-b667dad9db3f service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:07.066678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:07.067965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:07.068427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:07.068904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] PATH_INFO: `/v3/projects/5ffd9007d7d04983af7a99a2ca9e4b8b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:07.071450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffd9007d7d04983af7a99a2ca9e4b8b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:07.075482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:07.103283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:07.107017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:07.142808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9f58-9021-4580-aa44-a4bea4e86378 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:07.162843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:07.167365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:07.168191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:07.169465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] PATH_INFO: `/v3/projects/e5a6da1ac55846679e4d87a2b1009ff1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:07.176237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a6da1ac55846679e4d87a2b1009ff1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:07.195588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:07.274979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffd9007d7d04983af7a99a2ca9e4b8b', 'request_id': 'req-e7c03d14-107a-4b0d-a2f3-deefc128772d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.360966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffd9007d7d04983af7a99a2ca9e4b8b', 'request_id': 'req-e7c03d14-107a-4b0d-a2f3-deefc128772d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.368917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffd9007d7d04983af7a99a2ca9e4b8b', 'request_id': 'req-e7c03d14-107a-4b0d-a2f3-deefc128772d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.387821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] The token cache is being invalidate because project 5ffd9007d7d04983af7a99a2ca9e4b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:07.388126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.389091 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.391187 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1103/2284] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:06 2022] DELETE /identity/v3/projects/5ffd9007d7d04983af7a99a2ca9e4b8b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:07.395841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:07.401254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:07.412159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a6da1ac55846679e4d87a2b1009ff1', 'request_id': 'req-6c64bf0d-f70b-4382-8149-a161a63b037c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.417694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:07.526348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a6da1ac55846679e4d87a2b1009ff1', 'request_id': 'req-6c64bf0d-f70b-4382-8149-a161a63b037c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.536596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a6da1ac55846679e4d87a2b1009ff1', 'request_id': 'req-6c64bf0d-f70b-4382-8149-a161a63b037c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.549148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c03d14-107a-4b0d-a2f3-deefc128772d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:07.565402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] The token cache is being invalidate because project e5a6da1ac55846679e4d87a2b1009ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:07.565692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.567080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:07.570836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1182/2285] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:07 2022] DELETE /identity/v3/projects/e5a6da1ac55846679e4d87a2b1009ff1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:07.738392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:07.739753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:07.740215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:07.740817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] PATH_INFO: `/v3/users/43cd8eb438324459818cda747388e42b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:07.743891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43cd8eb438324459818cda747388e42b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:07.749325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:08.033658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43cd8eb438324459818cda747388e42b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:08.041105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43cd8eb438324459818cda747388e42b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:08.085194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43cd8eb438324459818cda747388e42b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:08.098902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43cd8eb438324459818cda747388e42b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:08.104994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9679bef7-dcf8-4725-add9-1221349f3d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43cd8eb438324459818cda747388e42b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:08.233709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1104/2286] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:07 2022] DELETE /identity/v3/users/43cd8eb438324459818cda747388e42b => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:09.731610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:09.734247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:09.758365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bf0d-f70b-4382-8149-a161a63b037c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:09.887242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:09.888192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:09.889105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:09.889644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] PATH_INFO: `/v3/projects/7cc473e6d7d547c6a3be67c73f5253d5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:09.891396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc473e6d7d547c6a3be67c73f5253d5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:09.893568 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:10.090976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:10.105888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc473e6d7d547c6a3be67c73f5253d5', 'request_id': 'req-8fffd58a-f5f5-484a-b199-b403e727934f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:10.223891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc473e6d7d547c6a3be67c73f5253d5', 'request_id': 'req-8fffd58a-f5f5-484a-b199-b403e727934f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:10.231751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc473e6d7d547c6a3be67c73f5253d5', 'request_id': 'req-8fffd58a-f5f5-484a-b199-b403e727934f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:10.246634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] The token cache is being invalidate because project 7cc473e6d7d547c6a3be67c73f5253d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:10.247361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:10.248348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fffd58a-f5f5-484a-b199-b403e727934f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:10.250707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1183/2287] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:09 2022] DELETE /identity/v3/projects/7cc473e6d7d547c6a3be67c73f5253d5 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:10.257429 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:10.258210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:10.258606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:10.291482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:10.294094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:10.331367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:10.387556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1105/2288] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:10.398784 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:10.399230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:10.399639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:10.439858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:10.441880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:10.460565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:10.481630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1184/2289] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:10.484461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14dc13-cc4e-46c6-ae25-8c2db681f63d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:10.493559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:10.519983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:10.519983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:10.519983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:10.519983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:10.519983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:10.519983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:10.521175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1106/2290] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:10.523436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:10.542590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b41d9-d032-4564-b755-ee4236de9098 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:10.549810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:10.550914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:10.551379 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:10.554471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:10.554471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:10.556833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:10.863287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1185/2291] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:10.867545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:10.878595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dc1d1-b17b-46eb-a348-2cb25d14e22b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:10.943744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:10.944352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:10.944633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:10.945024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:10.945655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:10.947659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.035336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1107/2292] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:10 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:11.041036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.047500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913f209-fdf8-40f6-b7ba-8d1c40e5a774 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.052118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.052849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.053142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.053421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.054190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.055814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.068062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1186/2293] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:11.078728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.090018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed7b7-0df8-4bd5-aca2-409e69f7952e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.095583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd35e8-4677-4a8b-afda-1d18f4cbfacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.096178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd35e8-4677-4a8b-afda-1d18f4cbfacc admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.096468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd35e8-4677-4a8b-afda-1d18f4cbfacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.096739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd35e8-4677-4a8b-afda-1d18f4cbfacc admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.097414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd35e8-4677-4a8b-afda-1d18f4cbfacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.099109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd35e8-4677-4a8b-afda-1d18f4cbfacc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.110671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1108/2294] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:11.123946 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.142889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f16d-d74e-4ccc-be84-3ed61c000a4d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.148294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.149856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.149856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.149856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] PATH_INFO: `/v3/projects/ce420d5af623443ea4df129869bf9a13/users/dfd4576cc91b447b846c7177a0594ca3/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.166532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce420d5af623443ea4df129869bf9a13, user_id=dfd4576cc91b447b846c7177a0594ca3, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.169257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.303624 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1187/2295] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:11 2022] PUT /identity/v3/projects/ce420d5af623443ea4df129869bf9a13/users/dfd4576cc91b447b846c7177a0594ca3/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:11.316663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.317508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.317508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.345416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] MFA Rules not processed for user `dfd4576cc91b447b846c7177a0594ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:11.346623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:11.430249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1109/2296] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:11.435628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.507754 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213713-836a-4f75-a13a-1b43c90695e3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.512624 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.513266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.513838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.514112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.514746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.516639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.658477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1188/2297] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:11 2022] POST /identity/v3/projects => generated 365 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:38:11.664047 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.692344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712769b-0d56-4cd3-b67e-a6e6d96cb934 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.723403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:11.767546 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.768174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.768503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.768848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.769499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.771488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.877525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1110/2298] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:11 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:11.882073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.893724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec4a24-3649-44e9-8e21-db958c452b81 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.898421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.899029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.899337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.899563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.900206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.901839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:11.916865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1189/2299] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:11.918904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:11.929327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa259b-70c0-4ad9-a553-0b511dd46340 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:11.934114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:11.934768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:11.935051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:11.935466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] PATH_INFO: `/v3/projects/e168bf00f2f74dc8adb5b4aa82640f1d/users/8fd8c3a628794c3e8d6f35912f718146/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:11.951275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e168bf00f2f74dc8adb5b4aa82640f1d, user_id=8fd8c3a628794c3e8d6f35912f718146, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:11.953981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:12.055155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1111/2300] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:11 2022] PUT /identity/v3/projects/e168bf00f2f74dc8adb5b4aa82640f1d/users/8fd8c3a628794c3e8d6f35912f718146/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:12.059532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:12.071253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26904-5150-4c36-9d47-33073a884a4c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:12.109942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:12.140924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d633177-15d3-498c-aafd-5064d5c06c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:12.141722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633177-15d3-498c-aafd-5064d5c06c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:12.142004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633177-15d3-498c-aafd-5064d5c06c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:12.142270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633177-15d3-498c-aafd-5064d5c06c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:12.142929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d633177-15d3-498c-aafd-5064d5c06c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:12.144550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d633177-15d3-498c-aafd-5064d5c06c34 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:12.157359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1190/2301] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:12.164428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:12.176178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173a283-cd72-4750-a7a9-72f42a87bfab admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:12.182020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:12.182717 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:12.183001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:12.183283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] PATH_INFO: `/v3/projects/e168bf00f2f74dc8adb5b4aa82640f1d/users/8fd8c3a628794c3e8d6f35912f718146/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:12.185799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e168bf00f2f74dc8adb5b4aa82640f1d, user_id=8fd8c3a628794c3e8d6f35912f718146, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:12.188459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:12.207936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1112/2302] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:12 2022] PUT /identity/v3/projects/e168bf00f2f74dc8adb5b4aa82640f1d/users/8fd8c3a628794c3e8d6f35912f718146/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:12.212239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:12.212529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:12.212815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:12.243392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] MFA Rules not processed for user `8fd8c3a628794c3e8d6f35912f718146`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:12.244637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:12.327253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1191/2303] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:12.338467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:12.340353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:12.406858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd713-610c-4aea-96e5-74517e5308f1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:12.410688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c25e-f711-4887-8404-5dc97ab0256a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:12.411462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c25e-f711-4887-8404-5dc97ab0256a service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:12.411844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c25e-f711-4887-8404-5dc97ab0256a service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:12.412204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c25e-f711-4887-8404-5dc97ab0256a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:12.427036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c25e-f711-4887-8404-5dc97ab0256a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:12.428478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c25e-f711-4887-8404-5dc97ab0256a service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:12.445957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1113/2304] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:12.820871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:12.822345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:12.834492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7550caa-4784-4e10-9130-77881668fe6a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:12.838124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:12.839156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:12.839156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:12.839436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:12.914276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:12.915827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:12.926785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1192/2305] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:22.434706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=58,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:22.828549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:22.828932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:22.829216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:22.850912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:22.852178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:22.927512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=76 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:22.942647 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1114/2306] 10.222.0.76 () {58 vars in 1009 bytes} [Wed Aug 31 19:38:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:22.959912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:22.962347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:23.056174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01971656-f92b-4351-8e4d-6ca16bfd138c service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:23.063040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37997fae-ef90-4b95-b51b-35f78d10cfa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:23.064327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997fae-ef90-4b95-b51b-35f78d10cfa2 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:23.064749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997fae-ef90-4b95-b51b-35f78d10cfa2 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:23.065133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997fae-ef90-4b95-b51b-35f78d10cfa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:23.078825 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997fae-ef90-4b95-b51b-35f78d10cfa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:23.081327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997fae-ef90-4b95-b51b-35f78d10cfa2 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:23.091130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1193/2307] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:38:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:38:24.439218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:24.522603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7bc7c-7fff-4e98-a86b-f8e3b26e5a93 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:24.558456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:24.559269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:24.559816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:24.559816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] PATH_INFO: `/v3/users/dfd4576cc91b447b846c7177a0594ca3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:24.563829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd4576cc91b447b846c7177a0594ca3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:24.567577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:24.836984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd4576cc91b447b846c7177a0594ca3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:24.837694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd4576cc91b447b846c7177a0594ca3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:24.851185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd4576cc91b447b846c7177a0594ca3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:24.858989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd4576cc91b447b846c7177a0594ca3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:24.859756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd4576cc91b447b846c7177a0594ca3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:24.951190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1115/2308] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:24 2022] DELETE /identity/v3/users/dfd4576cc91b447b846c7177a0594ca3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:24.956556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:24.957524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:24.958047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:24.982488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:24.984098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:25.061487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1194/2309] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:25.071371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:25.073036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:25.102087 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:25.146490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191cb2b-9e3b-4233-abdd-454fd5cbdfd9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:25.151489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:25.152165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:25.152450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:25.152771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:25.165273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:25.166891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:25.188528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1116/2310] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:25.838785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:25.840355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:25.861165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca74505-b6bb-4110-9589-c0cef6fea004 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:25.871723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:25.873021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:25.873311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:25.873593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] PATH_INFO: `/v3/projects/ce420d5af623443ea4df129869bf9a13` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:25.875581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce420d5af623443ea4df129869bf9a13)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:25.878528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:26.002846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce420d5af623443ea4df129869bf9a13', 'request_id': 'req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.060279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce420d5af623443ea4df129869bf9a13', 'request_id': 'req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.070095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce420d5af623443ea4df129869bf9a13', 'request_id': 'req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.088916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] The token cache is being invalidate because project ce420d5af623443ea4df129869bf9a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:26.089816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.091857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.094566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1195/2311] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:25 2022] DELETE /identity/v3/projects/ce420d5af623443ea4df129869bf9a13 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:26.100287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:26.116783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf61cd7-41c8-4cd1-92c5-6685182dfca6 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:26.208011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:26.209369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:26.209369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:26.209369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] PATH_INFO: `/v3/users/8fd8c3a628794c3e8d6f35912f718146` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:26.213165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd8c3a628794c3e8d6f35912f718146)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:26.215574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:26.517257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd8c3a628794c3e8d6f35912f718146'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.519075 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd8c3a628794c3e8d6f35912f718146'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.554877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd8c3a628794c3e8d6f35912f718146'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.598306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd8c3a628794c3e8d6f35912f718146'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.607252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-13ed850c-f9d7-4f62-85d5-b7780eb37d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd8c3a628794c3e8d6f35912f718146'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:26.745653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1117/2312] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:26 2022] DELETE /identity/v3/users/8fd8c3a628794c3e8d6f35912f718146 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:27.359491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:27.365667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:27.409465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f89f97-5060-46b4-9cf0-c5cb3ea4c7b2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:27.421273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:27.506713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:27.507564 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:27.507830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:27.508309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] PATH_INFO: `/v3/projects/e168bf00f2f74dc8adb5b4aa82640f1d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:27.509927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e168bf00f2f74dc8adb5b4aa82640f1d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:27.512602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.616542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e168bf00f2f74dc8adb5b4aa82640f1d', 'request_id': 'req-beb8ead4-823a-4998-a09a-57483a1d33bf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.733200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e168bf00f2f74dc8adb5b4aa82640f1d', 'request_id': 'req-beb8ead4-823a-4998-a09a-57483a1d33bf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.743650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e168bf00f2f74dc8adb5b4aa82640f1d', 'request_id': 'req-beb8ead4-823a-4998-a09a-57483a1d33bf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.774547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] The token cache is being invalidate because project e168bf00f2f74dc8adb5b4aa82640f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:28.783617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.783617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-beb8ead4-823a-4998-a09a-57483a1d33bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.783617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1196/2313] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:27 2022] DELETE /identity/v3/projects/e168bf00f2f74dc8adb5b4aa82640f1d => generated 0 bytes in 1422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:28.787487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.788515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.789117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.841452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:28.841452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:28.918312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:28.944385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1118/2314] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:28.959875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.960525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.960973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.990201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:28.991974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:29.004492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1197/2315] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:29.010553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.022707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8b02-7717-4433-a88b-71e1516e0145 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.031199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.038631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.038631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.038631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.038631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:29.038631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.038631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.056090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1119/2316] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:29.062268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.076842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d36a51-5578-4950-8527-ce9824e0b349 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.083499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.087549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.087549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.087549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.087549 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.088182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.297147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.304506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1198/2317] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:29.313373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37488f-a0ab-4568-87e8-a4a8d7a1a6e9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.448183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.449116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.449560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.449945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.450897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.453385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.674644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1120/2318] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/users => generated 294 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:29.679067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.692664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76918-3d1e-4a07-aa62-0aa4d18abab3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.699186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.699970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.701612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.702005 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.702966 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.706015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.736955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1199/2319] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:38:29.737209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.752177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992e07-6d8c-479b-b1eb-3726ca8026df admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.772845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8fd06-bb6b-4ed3-b662-69eef41722f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.772845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8fd06-bb6b-4ed3-b662-69eef41722f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.772845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8fd06-bb6b-4ed3-b662-69eef41722f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.772845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8fd06-bb6b-4ed3-b662-69eef41722f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.777182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8fd06-bb6b-4ed3-b662-69eef41722f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.777182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8fd06-bb6b-4ed3-b662-69eef41722f6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.782819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1121/2320] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:29.786999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.801663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f59e-84f4-4fe7-9170-bb02066f5e41 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.806656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.807495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.807750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.808025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] PATH_INFO: `/v3/projects/327aa1e17e334c84a650a6a036d359ac/users/6de709a312c9430faabe570db5aaefae/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.839649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327aa1e17e334c84a650a6a036d359ac, user_id=6de709a312c9430faabe570db5aaefae, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.844636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.936059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1200/2321] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:29 2022] PUT /identity/v3/projects/327aa1e17e334c84a650a6a036d359ac/users/6de709a312c9430faabe570db5aaefae/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:29.952594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.953432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.953597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.000692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] MFA Rules not processed for user `6de709a312c9430faabe570db5aaefae`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:30.002344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:30.116600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1122/2322] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:30.123529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:30.194050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:30.229080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979fef-6d35-40b8-abd5-2af5fe9bd6e8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.242855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.243550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.243841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.244123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.245281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.248677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.395174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1201/2323] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:30.399284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:30.415245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271062d-cc47-44cb-8e54-4c752e499d7d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.462349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:30.484757 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.485441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.485727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.486006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.486675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.489387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.589181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1123/2324] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:30 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:30.596933 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:30.609324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee08d-689c-4213-bc07-3760b0de2ff7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.614681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.615371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.615664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.615932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.616678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.619326 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.634948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1202/2325] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:30.636302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:30.648678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba646026-4f90-4331-99eb-a85e64ab3613 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.653698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.654360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.654644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.654920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] PATH_INFO: `/v3/projects/f87a28b5c5b24426b089b12937a8018b/users/6fa805e27a73489c825d9944aec706d6/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.673817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a28b5c5b24426b089b12937a8018b, user_id=6fa805e27a73489c825d9944aec706d6, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.679003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.780981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1124/2326] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:30 2022] PUT /identity/v3/projects/f87a28b5c5b24426b089b12937a8018b/users/6fa805e27a73489c825d9944aec706d6/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:30.785321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:30.800458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1fe8-433f-4207-9dfc-53897e115fb2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.964762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138835b0-820d-4f13-9e03-d0d08693c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.966537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138835b0-820d-4f13-9e03-d0d08693c0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.967107 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138835b0-820d-4f13-9e03-d0d08693c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.967665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138835b0-820d-4f13-9e03-d0d08693c0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.968697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138835b0-820d-4f13-9e03-d0d08693c0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.971488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138835b0-820d-4f13-9e03-d0d08693c0dd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.986781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1203/2327] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:30.991077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:31.004514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763d3fd-9499-40db-8691-b3553973ea98 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:31.010168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:31.011026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:31.011441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:31.011868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] PATH_INFO: `/v3/projects/f87a28b5c5b24426b089b12937a8018b/users/6fa805e27a73489c825d9944aec706d6/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:31.014573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a28b5c5b24426b089b12937a8018b, user_id=6fa805e27a73489c825d9944aec706d6, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:31.017543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:31.052063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1125/2328] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:30 2022] PUT /identity/v3/projects/f87a28b5c5b24426b089b12937a8018b/users/6fa805e27a73489c825d9944aec706d6/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:31.053630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:31.053925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:31.054202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:31.122705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] MFA Rules not processed for user `6fa805e27a73489c825d9944aec706d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:31.124352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:31.229121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1204/2329] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:31.241261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:31.246331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:31.337446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532df2-7808-4cea-be74-14ac6327697e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:31.343195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c194c3a-41f5-43f7-89c2-2cfaae27c8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:31.344248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c194c3a-41f5-43f7-89c2-2cfaae27c8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:31.344576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c194c3a-41f5-43f7-89c2-2cfaae27c8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:31.345085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c194c3a-41f5-43f7-89c2-2cfaae27c8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:31.364761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c194c3a-41f5-43f7-89c2-2cfaae27c8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:31.370043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c194c3a-41f5-43f7-89c2-2cfaae27c8f8 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:31.392285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1126/2330] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:33.525365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:33.660771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:33.722694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eca5f3-5acf-4fdb-b23d-e737c9781630 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:33.735434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:33.736233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:33.736865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:33.737447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] PATH_INFO: `/v3/users/6de709a312c9430faabe570db5aaefae` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:33.741080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de709a312c9430faabe570db5aaefae)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:33.745531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:34.110758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de709a312c9430faabe570db5aaefae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:34.132958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de709a312c9430faabe570db5aaefae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:34.145641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de709a312c9430faabe570db5aaefae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:34.146585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de709a312c9430faabe570db5aaefae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:34.253747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de709a312c9430faabe570db5aaefae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:34.264575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1205/2331] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:33 2022] DELETE /identity/v3/users/6de709a312c9430faabe570db5aaefae => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:34.269519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:34.270050 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:34.270167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:34.293953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:34.295328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:34.360902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1127/2332] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:34.370798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:34.372277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:34.446255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7302cf9-ba53-4c17-8bbe-4f5dda2b2c2d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:34.450572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:34.451196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:34.451475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:34.451753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:34.463622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:34.465152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:34.476034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1206/2333] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:35.078193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:35.081225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:35.104688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d82ae4-913e-4509-a1b2-85a810ea3d7a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:35.114456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:35.115489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:35.116325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:35.116325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] PATH_INFO: `/v3/projects/327aa1e17e334c84a650a6a036d359ac` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:35.118191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327aa1e17e334c84a650a6a036d359ac)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:35.121165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:35.312023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:35.329199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327aa1e17e334c84a650a6a036d359ac', 'request_id': 'req-bafb01c2-84bc-4271-b01f-96bbc6b3d167'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.457225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327aa1e17e334c84a650a6a036d359ac', 'request_id': 'req-bafb01c2-84bc-4271-b01f-96bbc6b3d167'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.464682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327aa1e17e334c84a650a6a036d359ac', 'request_id': 'req-bafb01c2-84bc-4271-b01f-96bbc6b3d167'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.477161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] The token cache is being invalidate because project 327aa1e17e334c84a650a6a036d359ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:35.477508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.478361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.480584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1128/2334] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:35 2022] DELETE /identity/v3/projects/327aa1e17e334c84a650a6a036d359ac => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:35.484867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:35.495744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14172f-d70d-4f0a-978b-4349add22356 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:35.557064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:35.566525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:35.567718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:35.568239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:35.568696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] PATH_INFO: `/v3/users/6fa805e27a73489c825d9944aec706d6` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:35.570610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa805e27a73489c825d9944aec706d6)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:35.574429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:35.832242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa805e27a73489c825d9944aec706d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.846622 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa805e27a73489c825d9944aec706d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.854349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa805e27a73489c825d9944aec706d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.855147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa805e27a73489c825d9944aec706d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.944965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0db62f7-ccd5-4f3f-9f7b-b52eb87818f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa805e27a73489c825d9944aec706d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:35.952611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1207/2335] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:35 2022] DELETE /identity/v3/users/6fa805e27a73489c825d9944aec706d6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:36.579441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:36.581638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:36.600166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb01c2-84bc-4271-b01f-96bbc6b3d167 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:36.670740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:36.671408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:36.671692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:36.671968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] PATH_INFO: `/v3/projects/f87a28b5c5b24426b089b12937a8018b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:36.673231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87a28b5c5b24426b089b12937a8018b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:36.675225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:36.806627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87a28b5c5b24426b089b12937a8018b', 'request_id': 'req-d0c66174-8cad-4168-954a-e49ecb6e7e9c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:36.911192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87a28b5c5b24426b089b12937a8018b', 'request_id': 'req-d0c66174-8cad-4168-954a-e49ecb6e7e9c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:36.919238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87a28b5c5b24426b089b12937a8018b', 'request_id': 'req-d0c66174-8cad-4168-954a-e49ecb6e7e9c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:36.933944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] The token cache is being invalidate because project f87a28b5c5b24426b089b12937a8018b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:36.934400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:36.935069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d0c66174-8cad-4168-954a-e49ecb6e7e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:36.936594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1129/2336] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:36 2022] DELETE /identity/v3/projects/f87a28b5c5b24426b089b12937a8018b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:36.941672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:36.942197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:36.942285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:36.967183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:36.968488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:37.038342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1208/2337] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:37.047192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.047503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.047744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.074740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:37.076253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:37.085581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1130/2338] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:37.092671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:37.104612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be3df1-854b-467b-9dce-fd2586885558 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:37.112761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:37.113546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.113897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.114247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.115067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:37.115381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:37.117076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:37.131172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1209/2339] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:37.138975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:37.169821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417a47-c405-4e7a-9596-02b8e1ff296f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:37.175487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:37.176519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.177005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.177490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.178147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:37.180941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:37.337182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1131/2340] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:37.338506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:37.351131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ba8f-1136-49db-a341-044e5f39b02a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:37.416828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:37.417461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.417749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.418009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.418678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:37.420607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:37.474713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:37.604087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1210/2341] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:37 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:37.604916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:37.618066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8212bb-0769-4f64-9dd0-19ede0815b08 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:37.624953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:37.625602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.625885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.626162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.626827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:37.628505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:37.640323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1132/2342] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:37.644495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:37.656006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05b71-ce94-496f-8b63-d270f65cf21d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:37.661436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197bfd-f4f1-4984-97dc-ea3e2c6d1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:37.661803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197bfd-f4f1-4984-97dc-ea3e2c6d1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.662172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197bfd-f4f1-4984-97dc-ea3e2c6d1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.662455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197bfd-f4f1-4984-97dc-ea3e2c6d1ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.663202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59197bfd-f4f1-4984-97dc-ea3e2c6d1ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:37.665032 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59197bfd-f4f1-4984-97dc-ea3e2c6d1ff4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:37.677878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1211/2343] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:38:37.683021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:37.696093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf441a8-7382-4a7c-b850-4cda7a4f5d35 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:37.701722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:37.702455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.702691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.702967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] PATH_INFO: `/v3/projects/5a0b6649a06244119914cbf326a77b08/users/e198b5efa24b4e7c9b94db0d9516d93b/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.712608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:37.719338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0b6649a06244119914cbf326a77b08, user_id=e198b5efa24b4e7c9b94db0d9516d93b, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:37.722082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:37.878583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1133/2344] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:37 2022] PUT /identity/v3/projects/5a0b6649a06244119914cbf326a77b08/users/e198b5efa24b4e7c9b94db0d9516d93b/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:37.898143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:37.898591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:37.898881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:37.933458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] MFA Rules not processed for user `e198b5efa24b4e7c9b94db0d9516d93b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:37.933458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:38.001438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1212/2345] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:38.006151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:38.070289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156fefd-bf8d-4a90-a0b9-f0d3b29c681d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:38.076933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:38.077552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:38.077836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:38.078114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:38.078762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:38.080766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:38.222814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1134/2346] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:38 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:38.227001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:38.239065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a71b-4352-4bb5-9c5c-602136d76334 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:38.317633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:38.318430 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:38.318816 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:38.320973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:38.320973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:38.322394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:38.579718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1213/2347] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:38 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:38.584672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:38.595480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1c0a-db95-47b4-aee2-7a0665ffd17d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:38.599925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:38.600725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:38.601035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:38.601308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:38.601948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:38.603559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:38.615069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1135/2348] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:38.619465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:38.629693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2373-af82-43c4-9a22-16395a79bbae admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:38.634401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e247-7fbd-4037-aa1f-6eebccfb77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:38.635040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e247-7fbd-4037-aa1f-6eebccfb77a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:38.635328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e247-7fbd-4037-aa1f-6eebccfb77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:38.635604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e247-7fbd-4037-aa1f-6eebccfb77a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:38.636281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590e247-7fbd-4037-aa1f-6eebccfb77a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:38.638750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590e247-7fbd-4037-aa1f-6eebccfb77a9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:38.649465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1214/2349] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:38.654290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:38.664854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354071f-56bf-46ae-9508-4ae6d1112746 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:38.669817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:38.670504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:38.670789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:38.671089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] PATH_INFO: `/v3/projects/03a97270bb16439fb61670ba734553b7/users/44fc3803f7ed403b988e5692d7c44e0f/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:38.691458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a97270bb16439fb61670ba734553b7, user_id=44fc3803f7ed403b988e5692d7c44e0f, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:38.694545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:38.840207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1136/2350] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:38 2022] PUT /identity/v3/projects/03a97270bb16439fb61670ba734553b7/users/44fc3803f7ed403b988e5692d7c44e0f/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:38.852463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:38.852745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:38.853059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:38.882545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] MFA Rules not processed for user `44fc3803f7ed403b988e5692d7c44e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:38.883931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:38.927329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:38.951155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1215/2351] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:38.955657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.018644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cb4bd-8d42-4e17-9246-9f269c8d713f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:39.023325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:39.023933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.024215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.024492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.025165 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:39.027074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:39.161337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1137/2352] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:38 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:39.165774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.176797 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd741b-4755-4832-b0bc-877c15c08018 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:39.240462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:39.241030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.241318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.241597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.242250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:39.244167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:39.376434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1216/2353] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:39 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:38:39.380907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.393300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a61b-4529-4165-8626-ce56c9a9c669 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:39.398613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:39.400438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.400438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.400438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.400438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:39.402211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:39.414225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1138/2354] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:39.419394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.435800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9600-65d6-4926-8b6a-adbae243cc8c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:39.442004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:39.442861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.443319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.443760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] PATH_INFO: `/v3/projects/5e26b1ad9e8a48d3939a4bdb040a1649/users/536215af4bcb4020975e0b254495079f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.464402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e26b1ad9e8a48d3939a4bdb040a1649, user_id=536215af4bcb4020975e0b254495079f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:39.467328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:39.655241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1217/2355] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:39 2022] PUT /identity/v3/projects/5e26b1ad9e8a48d3939a4bdb040a1649/users/536215af4bcb4020975e0b254495079f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:39.659176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.670137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88122f-c294-4248-91ea-bde1cffaa02b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:39.677843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:39.730199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b2fd5-ae30-48cc-94e7-8eddb7ad4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:39.730820 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2fd5-ae30-48cc-94e7-8eddb7ad4935 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.731594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2fd5-ae30-48cc-94e7-8eddb7ad4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.731970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2fd5-ae30-48cc-94e7-8eddb7ad4935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.732681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b2fd5-ae30-48cc-94e7-8eddb7ad4935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:39.734374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b2fd5-ae30-48cc-94e7-8eddb7ad4935 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:39.746552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1139/2356] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:39.751677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.762369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec821fe-30fe-42da-9103-8346820665c4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:39.767285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:39.767936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.768216 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.768495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] PATH_INFO: `/v3/projects/5e26b1ad9e8a48d3939a4bdb040a1649/users/536215af4bcb4020975e0b254495079f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.770439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e26b1ad9e8a48d3939a4bdb040a1649, user_id=536215af4bcb4020975e0b254495079f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:39.773177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:39.793381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1218/2357] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:39 2022] PUT /identity/v3/projects/5e26b1ad9e8a48d3939a4bdb040a1649/users/536215af4bcb4020975e0b254495079f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:39.803855 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:39.804175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:39.804531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:39.850099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] MFA Rules not processed for user `536215af4bcb4020975e0b254495079f`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:39.850504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:39.949655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1140/2358] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:39.974585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:39.977288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:40.045951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6646ef7-40fc-4377-b6f0-b2b2b25c0551 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:40.049842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e92e-70ac-41db-9710-905dbf3483ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:40.050455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e92e-70ac-41db-9710-905dbf3483ed service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:40.050738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e92e-70ac-41db-9710-905dbf3483ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:40.051015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e92e-70ac-41db-9710-905dbf3483ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:40.103260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:40.126078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648e92e-70ac-41db-9710-905dbf3483ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:40.127938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648e92e-70ac-41db-9710-905dbf3483ed service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:40.140230 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1219/2359] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:43.560226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:43.561768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:43.575085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa3dfb-7903-469f-ae5f-e4c96c148d6c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:43.579427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:43.580099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:43.580379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:43.580695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:43.660559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:43.662249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:43.673263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1141/2360] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:45.679926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.681217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.681217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.701461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:45.702696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:45.766823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1220/2361] 10.222.0.76 () {58 vars in 967 bytes} [Wed Aug 31 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:45.780987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.782450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:45.822205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:45.862482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12297035-e3c9-4b01-b637-025b46501d42 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.866979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.867597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.867880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.868155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.876774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.878410 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.886709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1142/2362] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:38:45.929526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.939907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72b55-d86c-46fc-bf4b-65a5df5abd32 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.945086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a585b0-ca5c-4b6f-aafb-9ebabaeac87d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.945086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a585b0-ca5c-4b6f-aafb-9ebabaeac87d service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.945086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a585b0-ca5c-4b6f-aafb-9ebabaeac87d service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.945840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a585b0-ca5c-4b6f-aafb-9ebabaeac87d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.956546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a585b0-ca5c-4b6f-aafb-9ebabaeac87d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.958084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a585b0-ca5c-4b6f-aafb-9ebabaeac87d service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.969445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1221/2363] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:51.270340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:51.352438 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f199e1-0e5f-4c3c-b2b2-5c7e45300416 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:51.366033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:51.366872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:51.367034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:51.367629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] PATH_INFO: `/v3/users/e198b5efa24b4e7c9b94db0d9516d93b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:51.369833 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e198b5efa24b4e7c9b94db0d9516d93b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:51.372131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:51.658237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e198b5efa24b4e7c9b94db0d9516d93b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.658892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e198b5efa24b4e7c9b94db0d9516d93b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.673093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e198b5efa24b4e7c9b94db0d9516d93b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.682195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e198b5efa24b4e7c9b94db0d9516d93b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.683177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e198b5efa24b4e7c9b94db0d9516d93b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.829525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1143/2364] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:51 2022] DELETE /identity/v3/users/e198b5efa24b4e7c9b94db0d9516d93b => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:51.833860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:51.834758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:51.835290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:51.860302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:51.861855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:51.949721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1222/2365] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:51.960374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:51.963449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:52.014242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:52.030242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a166088-61e5-4831-bc6a-25ce16b8aaf2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.037785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.038414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.038700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.038979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.049819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.051277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.062430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1144/2366] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:52.599281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.600743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:52.621531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eaefb-6c25-4ed1-be60-8e9e939a4e11 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.635084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.636302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.636690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.637180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] PATH_INFO: `/v3/projects/5a0b6649a06244119914cbf326a77b08` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.638604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0b6649a06244119914cbf326a77b08)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.640783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.791039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0b6649a06244119914cbf326a77b08', 'request_id': 'req-077e402c-50d4-4e05-bde0-eb70c70fdffa'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.905444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0b6649a06244119914cbf326a77b08', 'request_id': 'req-077e402c-50d4-4e05-bde0-eb70c70fdffa'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.914033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0b6649a06244119914cbf326a77b08', 'request_id': 'req-077e402c-50d4-4e05-bde0-eb70c70fdffa'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.928661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] The token cache is being invalidate because project 5a0b6649a06244119914cbf326a77b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:52.928998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.929829 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.932268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1223/2367] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:52 2022] DELETE /identity/v3/projects/5a0b6649a06244119914cbf326a77b08 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:52.941769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.953251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905e80e-a0ff-4732-854c-3e06963eba4b service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.010680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.011305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.011697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.012735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] PATH_INFO: `/v3/users/44fc3803f7ed403b988e5692d7c44e0f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.014030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fc3803f7ed403b988e5692d7c44e0f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.015967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.545314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fc3803f7ed403b988e5692d7c44e0f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:53.546465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fc3803f7ed403b988e5692d7c44e0f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:53.561563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fc3803f7ed403b988e5692d7c44e0f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:53.568379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fc3803f7ed403b988e5692d7c44e0f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:53.569085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fc3803f7ed403b988e5692d7c44e0f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:53.762541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1145/2368] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:52 2022] DELETE /identity/v3/users/44fc3803f7ed403b988e5692d7c44e0f => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:54.327181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:54.329401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:54.337647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:54.344053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e402c-50d4-4e05-bde0-eb70c70fdffa admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:54.418698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:54.419367 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:54.419649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:54.419925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] PATH_INFO: `/v3/projects/03a97270bb16439fb61670ba734553b7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:54.421244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a97270bb16439fb61670ba734553b7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:54.423201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:54.597526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a97270bb16439fb61670ba734553b7', 'request_id': 'req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:54.727522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a97270bb16439fb61670ba734553b7', 'request_id': 'req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:54.734928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a97270bb16439fb61670ba734553b7', 'request_id': 'req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:54.746837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] The token cache is being invalidate because project 03a97270bb16439fb61670ba734553b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:54.747144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:54.747833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:54.749451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1224/2369] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:54 2022] DELETE /identity/v3/projects/03a97270bb16439fb61670ba734553b7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:54.753461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:54.754963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:54.768856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044af2-36ab-4319-9d56-f3a2e66784e8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:54.835858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:54.836505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:54.836797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:54.837260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] PATH_INFO: `/v3/users/536215af4bcb4020975e0b254495079f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:54.838749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536215af4bcb4020975e0b254495079f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:54.840849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:54.843758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:55.113627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536215af4bcb4020975e0b254495079f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:55.114302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536215af4bcb4020975e0b254495079f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:55.128348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536215af4bcb4020975e0b254495079f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:55.136379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536215af4bcb4020975e0b254495079f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:55.138213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24b7ea3c-a6fa-4529-8029-611f3fa6dcd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536215af4bcb4020975e0b254495079f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:55.264996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1146/2370] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:54 2022] DELETE /identity/v3/users/536215af4bcb4020975e0b254495079f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:55.843811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:55.845359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:55.859222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbd12-c9c1-49eb-ab57-ac5f5707aa40 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:55.922521 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:55.923434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:55.923881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:55.924152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] PATH_INFO: `/v3/projects/5e26b1ad9e8a48d3939a4bdb040a1649` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:55.925491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e26b1ad9e8a48d3939a4bdb040a1649)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:55.927556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:56.101124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:56.112681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e26b1ad9e8a48d3939a4bdb040a1649', 'request_id': 'req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:56.252889 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e26b1ad9e8a48d3939a4bdb040a1649', 'request_id': 'req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:56.260293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e26b1ad9e8a48d3939a4bdb040a1649', 'request_id': 'req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:56.274627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] The token cache is being invalidate because project 5e26b1ad9e8a48d3939a4bdb040a1649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:56.274916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:56.275587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-eb77a4a4-b54c-47c4-9eee-fc1b5135be2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:56.277193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1225/2371] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:55 2022] DELETE /identity/v3/projects/5e26b1ad9e8a48d3939a4bdb040a1649 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:56.282863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:56.283385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:56.283518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:56.303664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:56.304923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:56.377386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1147/2372] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:56.385745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78127153-d601-4660-92f6-57950eabd097 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:56.386225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78127153-d601-4660-92f6-57950eabd097 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:56.386596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78127153-d601-4660-92f6-57950eabd097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:56.407425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-78127153-d601-4660-92f6-57950eabd097 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:56.408674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-78127153-d601-4660-92f6-57950eabd097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:56.417339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1226/2373] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:56.422217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:56.432548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b8276-2798-4975-a8c8-ec096fda7d3a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:56.438104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:56.438747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:56.439039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:56.439318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:56.439988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:56.440294 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:56.441957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:56.454532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1148/2374] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:56.459044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78127153-d601-4660-92f6-57950eabd097 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:56.468796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78127153-d601-4660-92f6-57950eabd097 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:56.473857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:56.474471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:56.474751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:56.475027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:56.475662 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:56.477654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:56.679801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1227/2375] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:56 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:56.692188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:56.699427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af964-7c99-4e3f-b61b-f60c57aaa8a7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:56.766048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:56.766804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:56.767172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:56.767282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:56.767844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:56.769954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:56.984284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:56.990807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1149/2376] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:56 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:56.997056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:57.008630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e368a3-16e8-4c18-9ec3-37d1db6f46f1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:57.013721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:57.014321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.014604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.014880 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.015528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:57.017272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:57.028967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1228/2377] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:57.033795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:57.051394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61aef-bda8-4d7c-8f1f-33f5e7d21d69 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:57.057007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b67a-5416-47a5-a702-06426ac7dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:57.057636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b67a-5416-47a5-a702-06426ac7dcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.057915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b67a-5416-47a5-a702-06426ac7dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.058412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b67a-5416-47a5-a702-06426ac7dcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.059148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b67a-5416-47a5-a702-06426ac7dcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:57.061037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b67a-5416-47a5-a702-06426ac7dcf2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:57.073340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1150/2378] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:57.077921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:57.088681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c7d9-1ff9-4e9b-876d-36aa3e514dd1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:57.094303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:57.095113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.095437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.095757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] PATH_INFO: `/v3/projects/01e8fccb859e4e41836319eb2cf4171d/users/0316cc5397b04632be63ae3009b05a42/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.114308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e8fccb859e4e41836319eb2cf4171d, user_id=0316cc5397b04632be63ae3009b05a42, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:57.117039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:57.222834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1229/2379] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:57 2022] PUT /identity/v3/projects/01e8fccb859e4e41836319eb2cf4171d/users/0316cc5397b04632be63ae3009b05a42/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:57.292674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.293879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.293879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.332298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] MFA Rules not processed for user `0316cc5397b04632be63ae3009b05a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:57.333828 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:57.416746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1151/2380] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:57.422100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:57.495983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86cee1-9d20-495a-958a-90af9928a516 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:57.501686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:57.502352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.502636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.502912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.503577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:57.507139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:57.677672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1230/2381] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:57 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:38:57.682321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:57.693860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c188b-213b-454e-af22-e6314c33c20f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:57.753419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:57.753950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.754233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.754510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.755156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:57.757118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:57.955842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1152/2382] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:57 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:38:57.960073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:57.973924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c958-9707-49d1-b31c-aba178215284 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:57.978938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:57.979540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:57.979833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:57.980097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:57.981506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:57.983145 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:57.994071 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1231/2383] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:57.998343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.009296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacca7-d86b-4714-83af-ec375140bfb0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.014623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1d0c-45fe-401f-9f2f-7d89270b6250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.019900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1d0c-45fe-401f-9f2f-7d89270b6250 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.019900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1d0c-45fe-401f-9f2f-7d89270b6250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.019900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1d0c-45fe-401f-9f2f-7d89270b6250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.019900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1d0c-45fe-401f-9f2f-7d89270b6250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.019900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1d0c-45fe-401f-9f2f-7d89270b6250 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.029365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1153/2384] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:58.033686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.055233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c728d10-a673-4213-8a54-cc587bbb437b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.060085 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.060740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.061059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.061339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] PATH_INFO: `/v3/projects/8fbbc26322b742c09eb9d95bce1e334f/users/7b3040e64168489ab68f7f38c54a8308/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.077296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbbc26322b742c09eb9d95bce1e334f, user_id=7b3040e64168489ab68f7f38c54a8308, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.080160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.167415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1232/2385] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:58 2022] PUT /identity/v3/projects/8fbbc26322b742c09eb9d95bce1e334f/users/7b3040e64168489ab68f7f38c54a8308/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:58.177953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.178250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.178542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.210476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] MFA Rules not processed for user `7b3040e64168489ab68f7f38c54a8308`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:58.211695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:58.272182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:58.296343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1154/2386] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:58.301275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.314164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.316208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:58.320727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:58.376118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4d975-4e0a-467e-87c5-587035e5ddbf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.381616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.382297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.382725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.383020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.383648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.385652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.395450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f986-2bbe-4da3-a8c1-87dec74c9f92 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.405065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.406789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.407549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.408411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.412936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:58.430979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.432442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.442196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1155/2387] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:38:58.530099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1233/2388] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:58 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:58.531839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.548825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7038-2876-4ef0-84fa-6ba2be9da0b4 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.640712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.641370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.641653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.641928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.642570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.644522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.764130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.766449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:58.785893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1156/2389] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:58 2022] POST /identity/v3/users => generated 298 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:58.790478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.803380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac9a9b-099c-4b31-916c-b6813112b144 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.811173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.811173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.811173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.811173 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.811557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.812432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.833592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1157/2390] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:38:58.835450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:58.853475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b335b2-ea51-43f7-813d-c7c00ff92ed0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.861539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.862608 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.863121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa585-6f14-40f5-818f-075843c875de admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:58.863279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.863604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] PATH_INFO: `/v3/projects/ae7be83e6cfa4bec9c962b553a7569bd/users/8518d86250f54b18910e941f482e4b4a/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.867021 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:58.867764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:58.868039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:58.868495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:58.871888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:58.888077 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.889582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.891830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7be83e6cfa4bec9c962b553a7569bd, user_id=8518d86250f54b18910e941f482e4b4a, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:58.896755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:58.912329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1234/2391] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:38:58.979865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1158/2392] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:58 2022] PUT /identity/v3/projects/ae7be83e6cfa4bec9c962b553a7569bd/users/8518d86250f54b18910e941f482e4b4a/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:59.021925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:59.034578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4b53e-bafe-4cec-bb07-360c22f287b1 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:59.124920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb548c-78f9-4df6-a7c7-742f33abe44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:59.124920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb548c-78f9-4df6-a7c7-742f33abe44f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:59.124920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb548c-78f9-4df6-a7c7-742f33abe44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:59.124920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb548c-78f9-4df6-a7c7-742f33abe44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:59.125711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb548c-78f9-4df6-a7c7-742f33abe44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:59.125711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb548c-78f9-4df6-a7c7-742f33abe44f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:59.145993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1235/2393] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:59.148153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:59.165974 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20eef3-45f0-481b-a180-199ef73cd62e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:59.176612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:59.178709 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:59.178852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:59.179554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] PATH_INFO: `/v3/projects/ae7be83e6cfa4bec9c962b553a7569bd/users/8518d86250f54b18910e941f482e4b4a/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:59.183306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7be83e6cfa4bec9c962b553a7569bd, user_id=8518d86250f54b18910e941f482e4b4a, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:59.191151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:59.217042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1159/2394] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:59 2022] PUT /identity/v3/projects/ae7be83e6cfa4bec9c962b553a7569bd/users/8518d86250f54b18910e941f482e4b4a/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:59.243131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:59.244063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:59.244906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:59.296406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] MFA Rules not processed for user `8518d86250f54b18910e941f482e4b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:59.298163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:59.331900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:59.423577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1236/2395] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:59.438285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:59.440488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:59.476520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:59.509454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50deb6e3-330c-4aa4-a120-7cf59216c758 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:59.514183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:59.519336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:59.519336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:59.519336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:59.623281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:59.630972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:59.659779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1160/2396] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:02.294008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:02.299365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:02.315073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69994cf-4f3e-48ee-8d4a-a1c52b7ea19f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:02.320884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:02.321453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:02.321743 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:02.322034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:02.408975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:02.410423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:02.420373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1237/2397] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:03.287879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:03.290385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:03.426601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e58c8-fc20-4120-ab69-3bad80ad2f36 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:03.438230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:03.438999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:03.439390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:03.439732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:03.442427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:03.464639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:03.466488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:03.485918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:03.487449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:03.488633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1161/2398] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:03.615648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507630-a0e9-4c6d-8b20-3c86beb707e8 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:03.620653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:03.621991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:03.622363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:03.622740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] PATH_INFO: `/v3/users/bec99c3414d44b85981e0122b0b4aa53` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:03.624205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec99c3414d44b85981e0122b0b4aa53)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:03.626604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:03.978749 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec99c3414d44b85981e0122b0b4aa53'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.997039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:04.004280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec99c3414d44b85981e0122b0b4aa53'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.011607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec99c3414d44b85981e0122b0b4aa53'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.012742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec99c3414d44b85981e0122b0b4aa53'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.133254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.134929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:04.154080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bc1b5-9833-425f-8789-ad71723ffe83 service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.159217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.159920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.160350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.160930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] PATH_INFO: `/v3/users/5d72d15d3d7848baaba2968bb4a16ebb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.162503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d72d15d3d7848baaba2968bb4a16ebb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.164386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.182585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec99c3414d44b85981e0122b0b4aa53'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.201147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1238/2399] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:03 2022] DELETE /identity/v3/users/bec99c3414d44b85981e0122b0b4aa53 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:04.592059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d72d15d3d7848baaba2968bb4a16ebb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.592999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d72d15d3d7848baaba2968bb4a16ebb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.610457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d72d15d3d7848baaba2968bb4a16ebb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.612733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:04.618295 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d72d15d3d7848baaba2968bb4a16ebb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.619043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-74139b8e-7412-4969-a024-86b973079c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d72d15d3d7848baaba2968bb4a16ebb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:04.650915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.650915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:04.731930 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559fcd3-c7b7-4ddb-b913-0d587e0a9702 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.746459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.746459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.746459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.746459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] PATH_INFO: `/v3/projects/f3767bf3aa7943c085a5daf9f310bcba` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.746894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3767bf3aa7943c085a5daf9f310bcba)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.746894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:05.014287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1162/2400] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:04 2022] DELETE /identity/v3/users/5d72d15d3d7848baaba2968bb4a16ebb => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:05.035153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3767bf3aa7943c085a5daf9f310bcba', 'request_id': 'req-a3a08f43-b9c3-4323-81c2-b60858114f94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.230257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3767bf3aa7943c085a5daf9f310bcba', 'request_id': 'req-a3a08f43-b9c3-4323-81c2-b60858114f94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.242704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3767bf3aa7943c085a5daf9f310bcba', 'request_id': 'req-a3a08f43-b9c3-4323-81c2-b60858114f94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.261055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] The token cache is being invalidate because project f3767bf3aa7943c085a5daf9f310bcba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:05.261055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.262717 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.264720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1239/2401] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:04 2022] DELETE /identity/v3/projects/f3767bf3aa7943c085a5daf9f310bcba => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:05.271449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.271987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.272480 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.296505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:05.297940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.333798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:05.336391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.404069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1163/2402] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:05.404998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:05.406916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.464026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08f43-b9c3-4323-81c2-b60858114f94 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:05.472515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:05.473638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.474141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.474777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] PATH_INFO: `/v3/projects/0c176bad9eb64562a480dd290f053f59` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.476428 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c176bad9eb64562a480dd290f053f59)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:05.479715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:05.480515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ad843-7962-465f-b5d8-242a188c4371 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:05.486714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:05.487531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.487752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.488024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.489834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.564724 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:05.566260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e238-178e-4d6b-b757-e7ce4d175c3c service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:05.576414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1164/2403] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:05.577673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.577959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.578238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.598683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:05.599626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.607383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1165/2404] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:05.612950 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:05.623477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60eb12-df4b-4472-8bb3-e9f6a844c6af None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:05.629059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:05.633288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.633288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.633288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.633288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:05.633288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:05.633288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:05.651405 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1166/2405] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:39:05.655921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:05.657474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c176bad9eb64562a480dd290f053f59', 'request_id': 'req-68706e23-f6ac-4847-bc9f-f4150334adb5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.666179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720490-db8b-453c-ac19-63badfbcbb04 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:05.725159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:05.725986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.726395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.726741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.727437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:05.729830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:05.812713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c176bad9eb64562a480dd290f053f59', 'request_id': 'req-68706e23-f6ac-4847-bc9f-f4150334adb5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.819891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c176bad9eb64562a480dd290f053f59', 'request_id': 'req-68706e23-f6ac-4847-bc9f-f4150334adb5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.831115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] The token cache is being invalidate because project 0c176bad9eb64562a480dd290f053f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:05.831391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.832084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-68706e23-f6ac-4847-bc9f-f4150334adb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:05.833724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1240/2406] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:05 2022] DELETE /identity/v3/projects/0c176bad9eb64562a480dd290f053f59 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:05.839321 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250805f3-88c4-43c7-99e3-de17cdabe470 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.839644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250805f3-88c4-43c7-99e3-de17cdabe470 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.839936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250805f3-88c4-43c7-99e3-de17cdabe470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.862401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-250805f3-88c4-43c7-99e3-de17cdabe470 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:05.863651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-250805f3-88c4-43c7-99e3-de17cdabe470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.872716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1241/2407] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:05.881146 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:05.881486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:05.881806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:05.902579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:05.903890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.908147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1167/2408] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:05 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:05.912611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:05.914434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:05.917346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1242/2409] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:05.923087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:05.935089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a0a0-00fa-4880-affe-c52ae21472bc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.018283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62954b3-7bac-40d4-9e74-64c4504d8bff admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.029016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.043440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.043440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.043440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.043440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.043440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.050001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.050001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.050001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.050001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.050699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:06.050699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.051358 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.074401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1243/2410] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:39:06.078630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.093590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f370b-f53c-4205-a2c1-192dd9077fca admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.098563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.099276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.099678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.099996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.100713 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.103063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.167387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1168/2411] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:05 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:06.173826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.191715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6114-f7fa-4bfd-ab5b-626e60f9b8f5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.200138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.201174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.201659 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.202148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.203290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.206378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.222553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1169/2412] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:06.226739 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.242382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcfe7a-458d-4b0e-8061-ceacf7e20206 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.247511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1244/2413] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:06 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:06.249451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.316609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.317859 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.318237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.318603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.319771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.321585 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.329727 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09617eab-4ff9-4c76-8295-2f8bcf35e283 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.337769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.338812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1170/2414] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:06.338954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.339137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.339574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.340461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.343524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.343763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.359543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b72f0-c66c-47c9-986e-30be7c972346 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.366204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688cb68-fd61-451c-a44d-fca2b408fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.367388 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688cb68-fd61-451c-a44d-fca2b408fb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.367790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688cb68-fd61-451c-a44d-fca2b408fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.368185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688cb68-fd61-451c-a44d-fca2b408fb89 admin admin] PATH_INFO: `/v3/projects/2cf9220cb80946c9bfd894fc53cdd949/users/227045489aeb4a07b37d00507de0d7f5/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.384684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:06.393301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688cb68-fd61-451c-a44d-fca2b408fb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf9220cb80946c9bfd894fc53cdd949, user_id=227045489aeb4a07b37d00507de0d7f5, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.396046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688cb68-fd61-451c-a44d-fca2b408fb89 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.451353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1245/2415] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:06 2022] POST /identity/v3/users => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:06.455741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.468329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036529-d2a5-42f2-a7df-48d240a93389 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.473660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.474348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.474633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.474925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.475584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.477245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.488957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1246/2416] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:06.493083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.504060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6f72-eef9-4e55-9fcc-16730015f72b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.509162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.509771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.510163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.510659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.511031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.512981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.526553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1247/2417] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:06.530960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1171/2418] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:06 2022] PUT /identity/v3/projects/2cf9220cb80946c9bfd894fc53cdd949/users/227045489aeb4a07b37d00507de0d7f5/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:06.535823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.538931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.539326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.539671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.553082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85117d9-17ed-4663-be93-8a7e11337d62 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.580595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] MFA Rules not processed for user `227045489aeb4a07b37d00507de0d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:06.582337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:06.626088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bc340-b30f-4c98-a5df-df997ea0bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.626769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc340-b30f-4c98-a5df-df997ea0bd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.627052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc340-b30f-4c98-a5df-df997ea0bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.627334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc340-b30f-4c98-a5df-df997ea0bd2a admin admin] PATH_INFO: `/v3/projects/cc460a8b95454ade8c35dfe029fa0864/users/0179278474864aef81f6a0102a1dc4ae/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.650445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bc340-b30f-4c98-a5df-df997ea0bd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc460a8b95454ade8c35dfe029fa0864, user_id=0179278474864aef81f6a0102a1dc4ae, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.653612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bc340-b30f-4c98-a5df-df997ea0bd2a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.678932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1172/2419] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:06.690839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.692265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:06.749062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:06.753376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed5c8b-ea9b-4f4b-b4c6-105d0794bae1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.754407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1248/2420] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:06 2022] PUT /identity/v3/projects/cc460a8b95454ade8c35dfe029fa0864/users/0179278474864aef81f6a0102a1dc4ae/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:06.767902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.768269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.768651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.799029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] MFA Rules not processed for user `0179278474864aef81f6a0102a1dc4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:06.800368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:06.810680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.815656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.815656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.815656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.877951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1249/2421] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:06.878156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.879439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.880491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.889894 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1173/2422] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:06.952781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec10290-daa5-4b41-9453-7920ad3c6344 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.958445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.959233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.959548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.959827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.960482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.970608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.120196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1250/2423] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:06 2022] POST /identity/v3/projects => generated 405 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:07.121873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:07.133350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3725-e38e-4bfe-a98c-b97a2f00312e service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:07.200552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:07.201210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.201538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.201794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.202404 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:07.204369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.421300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1174/2424] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:07 2022] POST /identity/v3/users => generated 309 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:07.425402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:07.436480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab981b9-b910-4fdb-b425-ae1f6bc1469d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:07.441113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:07.441715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.441995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.442268 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.442908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:07.444496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.454525 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1251/2425] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:07.458763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:07.468544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599af6e-ed3f-4378-a10e-73efbf65adfe admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:07.474726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:07.475375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.475653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.475926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] PATH_INFO: `/v3/projects/74b507d100e948f9a1f79c57b225aa73/users/8a4969c5b9214cb38ab18ea70e0da3c5/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.490895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b507d100e948f9a1f79c57b225aa73, user_id=8a4969c5b9214cb38ab18ea70e0da3c5, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:07.493587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.650857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1175/2426] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:07 2022] PUT /identity/v3/projects/74b507d100e948f9a1f79c57b225aa73/users/8a4969c5b9214cb38ab18ea70e0da3c5/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:07.655729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:07.665904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67536d9-259d-4b00-a99c-9b6ca839b2c6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:07.723418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647808-8cc3-4cc3-9eb2-9c0e37c8a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:07.724030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647808-8cc3-4cc3-9eb2-9c0e37c8a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.724316 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647808-8cc3-4cc3-9eb2-9c0e37c8a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.724593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647808-8cc3-4cc3-9eb2-9c0e37c8a5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.725329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647808-8cc3-4cc3-9eb2-9c0e37c8a5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:07.726999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647808-8cc3-4cc3-9eb2-9c0e37c8a5cf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.738635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1252/2427] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:07.743006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:07.753844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba141c-50bc-40f3-af82-c8d8eec682df admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:07.758430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:07.759078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.759383 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.759662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] PATH_INFO: `/v3/projects/74b507d100e948f9a1f79c57b225aa73/users/8a4969c5b9214cb38ab18ea70e0da3c5/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.761649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b507d100e948f9a1f79c57b225aa73, user_id=8a4969c5b9214cb38ab18ea70e0da3c5, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:07.764535 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.775378 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1176/2428] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:07 2022] PUT /identity/v3/projects/74b507d100e948f9a1f79c57b225aa73/users/8a4969c5b9214cb38ab18ea70e0da3c5/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:07.790436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.790962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.790962 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.819508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] MFA Rules not processed for user `8a4969c5b9214cb38ab18ea70e0da3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:07.820830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:07.890980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1253/2429] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:08.036384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:08.099493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5f2a-8f16-4421-b98b-7dd4e99b60d4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:08.103111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada6ce-85b8-4269-a473-2e358f0bab70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:08.103738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada6ce-85b8-4269-a473-2e358f0bab70 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:08.104019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada6ce-85b8-4269-a473-2e358f0bab70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:08.104307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada6ce-85b8-4269-a473-2e358f0bab70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:08.115691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada6ce-85b8-4269-a473-2e358f0bab70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:08.119949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfada6ce-85b8-4269-a473-2e358f0bab70 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:08.127887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1177/2430] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:08 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:08.406777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:08.468536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:08.485179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86afcf-117d-4690-8f46-d0ed90b25d2f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:08.490175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:08.491650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:08.491650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:08.491650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] PATH_INFO: `/v3/users/0179278474864aef81f6a0102a1dc4ae` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:08.493011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0179278474864aef81f6a0102a1dc4ae)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:08.495047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:08.647064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:08.826482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0179278474864aef81f6a0102a1dc4ae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:08.841885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0179278474864aef81f6a0102a1dc4ae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:08.853337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0179278474864aef81f6a0102a1dc4ae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:08.854100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0179278474864aef81f6a0102a1dc4ae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:08.950003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0179278474864aef81f6a0102a1dc4ae'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:08.957038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1254/2431] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:08 2022] DELETE /identity/v3/users/0179278474864aef81f6a0102a1dc4ae => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:08.961649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:08.962284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:08.962284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:08.983389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:08.984667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:09.054177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1178/2432] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:09.066136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:09.067656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:09.144112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520d6f1-9e1d-47e5-b39b-cb439b459c91 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:09.147951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:09.148578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:09.148917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:09.149202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:09.161056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:09.162720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:09.173310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1255/2433] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:09.977721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:09.978878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:09.993879 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b5758-cfa6-44c7-9630-0419a9633f1d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:10.001688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:10.003076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:10.004185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:10.004986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] PATH_INFO: `/v3/projects/cc460a8b95454ade8c35dfe029fa0864` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:10.007119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc460a8b95454ade8c35dfe029fa0864)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:10.010059 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:10.203587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc460a8b95454ade8c35dfe029fa0864', 'request_id': 'req-15a392c3-d80e-4e19-b364-846e6c72af73'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.265688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:10.350066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc460a8b95454ade8c35dfe029fa0864', 'request_id': 'req-15a392c3-d80e-4e19-b364-846e6c72af73'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.364390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc460a8b95454ade8c35dfe029fa0864', 'request_id': 'req-15a392c3-d80e-4e19-b364-846e6c72af73'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.379116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] The token cache is being invalidate because project cc460a8b95454ade8c35dfe029fa0864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:10.379669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.380589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.382703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1179/2434] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:09 2022] DELETE /identity/v3/projects/cc460a8b95454ade8c35dfe029fa0864 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:10.387478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:10.398495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598ed91-81e4-47a8-8862-2683bba93637 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:10.491781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:10.492690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:10.493172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:10.493814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] PATH_INFO: `/v3/users/8a4969c5b9214cb38ab18ea70e0da3c5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:10.495222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4969c5b9214cb38ab18ea70e0da3c5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:10.498327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:10.812065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4969c5b9214cb38ab18ea70e0da3c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.830281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4969c5b9214cb38ab18ea70e0da3c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.838290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4969c5b9214cb38ab18ea70e0da3c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:10.839303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4969c5b9214cb38ab18ea70e0da3c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:11.040869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bbb2e0a3-c3e7-4bc6-a90c-cd9e373ce795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4969c5b9214cb38ab18ea70e0da3c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:11.049054 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1256/2435] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:10 2022] DELETE /identity/v3/users/8a4969c5b9214cb38ab18ea70e0da3c5 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:11.541586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:11.769390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:11.774285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:11.798733 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a392c3-d80e-4e19-b364-846e6c72af73 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:11.911965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:11.913169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:11.913555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:11.914385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] PATH_INFO: `/v3/projects/74b507d100e948f9a1f79c57b225aa73` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:11.916123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b507d100e948f9a1f79c57b225aa73)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:11.919311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:12.170548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b507d100e948f9a1f79c57b225aa73', 'request_id': 'req-529a5da2-aad1-4e3a-8365-55f633f2bad3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.339227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b507d100e948f9a1f79c57b225aa73', 'request_id': 'req-529a5da2-aad1-4e3a-8365-55f633f2bad3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.346784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b507d100e948f9a1f79c57b225aa73', 'request_id': 'req-529a5da2-aad1-4e3a-8365-55f633f2bad3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.363523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] The token cache is being invalidate because project 74b507d100e948f9a1f79c57b225aa73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:12.363960 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.364891 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.366350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1180/2436] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:11 2022] DELETE /identity/v3/projects/74b507d100e948f9a1f79c57b225aa73 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:12.372303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d34dcc-8707-4d0a-9ebc-5a47d95613ac None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:12.377196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d34dcc-8707-4d0a-9ebc-5a47d95613ac None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:12.377196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d34dcc-8707-4d0a-9ebc-5a47d95613ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:12.406251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-55d34dcc-8707-4d0a-9ebc-5a47d95613ac None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:12.407814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-55d34dcc-8707-4d0a-9ebc-5a47d95613ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:12.468540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:12.470028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:12.493928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1257/2437] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:12.501764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:12.502056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:12.502465 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:12.535994 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:12.539586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:12.552172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1258/2438] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:12.557985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:12.571458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7252-c143-426a-9ed7-4733eb1804e7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:12.577405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:12.577907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:12.578189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:12.578589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:12.579121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:12.579424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:12.581304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:12.613660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1259/2439] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:12.616250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:12.630667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5da2-aad1-4e3a-8365-55f633f2bad3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:12.634519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3fec-23ae-4dd7-a483-4110527f2468 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:12.637702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:12.638343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:12.638641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:12.638890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] PATH_INFO: `/v3/users/0316cc5397b04632be63ae3009b05a42` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:12.640761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0316cc5397b04632be63ae3009b05a42)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:12.643682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:12.649769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:12.651238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:12.653693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:12.653693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:12.654424 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:12.658207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:12.816451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1260/2440] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:12 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:12.817690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:12.895501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849a2f-5fb8-4220-9bfc-a497c3e9eda4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:12.900228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:12.900855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:12.901143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:12.901419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:12.902597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:12.904660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:12.975183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0316cc5397b04632be63ae3009b05a42'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.975940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0316cc5397b04632be63ae3009b05a42'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.989942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0316cc5397b04632be63ae3009b05a42'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.997468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0316cc5397b04632be63ae3009b05a42'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:12.998216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-edda2bfb-1cdb-4083-84c5-6245d747a867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0316cc5397b04632be63ae3009b05a42'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:13.090729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1261/2441] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:12 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:13.095169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:13.096863 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:13.110300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038453-dbee-4701-a5c4-ea7658563bf1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:13.114953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:13.116529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.116529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.116529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.116886 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:13.118509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:13.129601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1262/2442] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:13.134284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:13.144418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee754dfb-2ee3-4b89-8fec-c4faa52a3af9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:13.149931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:13.150469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.150755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.151030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.151669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:13.153543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:13.165471 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1263/2443] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:13.170554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:13.180596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4bc8-652b-4dba-9aa9-74edfaea4ac4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:13.186440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744a745-bcce-4c82-b264-54a81c789b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:13.187133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744a745-bcce-4c82-b264-54a81c789b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.187418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744a745-bcce-4c82-b264-54a81c789b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.187698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744a745-bcce-4c82-b264-54a81c789b53 admin admin] PATH_INFO: `/v3/projects/09ca2efcf7d744afb7730c7dc08faa35/users/b0f998b02c374b6f9a447b44ae70e405/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.203345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1181/2444] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:12 2022] DELETE /identity/v3/users/0316cc5397b04632be63ae3009b05a42 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:13.209520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744a745-bcce-4c82-b264-54a81c789b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ca2efcf7d744afb7730c7dc08faa35, user_id=b0f998b02c374b6f9a447b44ae70e405, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:13.212219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744a745-bcce-4c82-b264-54a81c789b53 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:13.217189 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.217601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.218055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.238117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:13.239414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:13.306988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1182/2445] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:13.320040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:13.321468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:13.378893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274265c6-4042-4e1c-a036-c379dc22e1cc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:13.384340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1264/2446] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:13 2022] PUT /identity/v3/projects/09ca2efcf7d744afb7730c7dc08faa35/users/b0f998b02c374b6f9a447b44ae70e405/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:13.397785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.398231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.398509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.428204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] MFA Rules not processed for user `b0f998b02c374b6f9a447b44ae70e405`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:13.429294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:13.443782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:13.444918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.445455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.445818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.532102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1265/2447] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:13.533126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:13.535635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:13.536634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:13.546945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1183/2448] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:13.554711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7bc03-dba6-47e7-ad4b-3cffb9f81e9b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:13.563612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:13.564148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.564550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.570392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.570392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:13.570392 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:13.596452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:13.831998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1266/2449] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:13 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:13.836150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:13.846403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0816-a428-47fd-9e07-e6d321587bd8 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:13.904358 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:13.905022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:13.905305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:13.905581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:13.906242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:13.908208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.187508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1184/2450] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:13 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:14.188101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.198517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ebc8-a053-4180-81be-9a302c3e21cb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:14.202984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:14.203589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.203874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.204143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.204783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:14.206409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.217364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1267/2451] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:14.221681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.232641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54955b0-9c34-48ff-ac7f-8aaffa5e3a44 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:14.237370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:14.238068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.238354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.238634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] PATH_INFO: `/v3/projects/74dd10cbd9ef4863bd54ef42dc2a943d/users/7e3381eb5a8545b18c8bd18e448484cb/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.255646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dd10cbd9ef4863bd54ef42dc2a943d, user_id=7e3381eb5a8545b18c8bd18e448484cb, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:14.258433 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.464819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.466771 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:14.496611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dcde0-1e23-45eb-af1c-c9dcc8e4e0f3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:14.496611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:14.496611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.496611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.497236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] PATH_INFO: `/v3/projects/01e8fccb859e4e41836319eb2cf4171d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.497236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e8fccb859e4e41836319eb2cf4171d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:14.497236 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.570806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1185/2452] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:14 2022] PUT /identity/v3/projects/74dd10cbd9ef4863bd54ef42dc2a943d/users/7e3381eb5a8545b18c8bd18e448484cb/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:14.574072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.640514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1511795-6bca-45bb-89ca-9a181d118abc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:14.646046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:14.646757 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.647052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.647333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.647989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:14.649674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.660397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1186/2453] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:14.664552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.674821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b671b-f296-463c-9a84-c081796cf2a4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:14.679742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca6d7-2f68-46e6-9414-30f595bbbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:14.680367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca6d7-2f68-46e6-9414-30f595bbbb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.683972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca6d7-2f68-46e6-9414-30f595bbbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.683972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca6d7-2f68-46e6-9414-30f595bbbb80 admin admin] PATH_INFO: `/v3/projects/74dd10cbd9ef4863bd54ef42dc2a943d/users/7e3381eb5a8545b18c8bd18e448484cb/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.683972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eca6d7-2f68-46e6-9414-30f595bbbb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dd10cbd9ef4863bd54ef42dc2a943d, user_id=7e3381eb5a8545b18c8bd18e448484cb, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:14.685582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eca6d7-2f68-46e6-9414-30f595bbbb80 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.695857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1187/2454] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:14 2022] PUT /identity/v3/projects/74dd10cbd9ef4863bd54ef42dc2a943d/users/7e3381eb5a8545b18c8bd18e448484cb/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:14.706664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.707007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.707389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.738837 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] MFA Rules not processed for user `7e3381eb5a8545b18c8bd18e448484cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:14.741243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:14.763628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e8fccb859e4e41836319eb2cf4171d', 'request_id': 'req-948bfa6b-43cf-4759-ade3-9df560f1e875'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:14.832575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1188/2455] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:14.843749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.845128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:14.908698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7596cd-c755-4e40-a247-3dca63e43eb0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:14.910239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e8fccb859e4e41836319eb2cf4171d', 'request_id': 'req-948bfa6b-43cf-4759-ade3-9df560f1e875'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:14.914025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:14.914803 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:14.920897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:14.920897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:14.921201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e8fccb859e4e41836319eb2cf4171d', 'request_id': 'req-948bfa6b-43cf-4759-ade3-9df560f1e875'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:14.926667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:14.928219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:14.933832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] The token cache is being invalidate because project 01e8fccb859e4e41836319eb2cf4171d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:14.934131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:14.934803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:14.936480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1268/2456] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:14 2022] DELETE /identity/v3/projects/01e8fccb859e4e41836319eb2cf4171d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:14.942208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1189/2457] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:14.942943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:14.945074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:15.023846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfa6b-43cf-4759-ade3-9df560f1e875 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:15.029195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:15.029848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:15.030127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:15.030397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] PATH_INFO: `/v3/users/7b3040e64168489ab68f7f38c54a8308` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:15.031550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3040e64168489ab68f7f38c54a8308)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:15.033519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:15.346259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:15.368070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3040e64168489ab68f7f38c54a8308'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:15.380657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3040e64168489ab68f7f38c54a8308'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:15.388846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3040e64168489ab68f7f38c54a8308'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:15.394659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3040e64168489ab68f7f38c54a8308'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:15.549501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3040e64168489ab68f7f38c54a8308'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:15.556112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1269/2458] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:14 2022] DELETE /identity/v3/users/7b3040e64168489ab68f7f38c54a8308 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:16.308018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:16.325959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06220-f3f0-464e-b472-67bd9da48dd9 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:16.388878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:16.394891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:16.408492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:16.409188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:16.409469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:16.409812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] PATH_INFO: `/v3/projects/8fbbc26322b742c09eb9d95bce1e334f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:16.412201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fbbc26322b742c09eb9d95bce1e334f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:16.416702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:16.475614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3b98-97df-4b3f-9fa9-8f2615fd9386 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:16.482279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:16.483168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:16.483590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:16.484003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] PATH_INFO: `/v3/users/b0f998b02c374b6f9a447b44ae70e405` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:16.485455 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f998b02c374b6f9a447b44ae70e405)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:16.487939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:16.653195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fbbc26322b742c09eb9d95bce1e334f', 'request_id': 'req-d19965de-e745-4aa7-88da-711b8a5cf281'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.802226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fbbc26322b742c09eb9d95bce1e334f', 'request_id': 'req-d19965de-e745-4aa7-88da-711b8a5cf281'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.810600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fbbc26322b742c09eb9d95bce1e334f', 'request_id': 'req-d19965de-e745-4aa7-88da-711b8a5cf281'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.818131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f998b02c374b6f9a447b44ae70e405'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.825686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] The token cache is being invalidate because project 8fbbc26322b742c09eb9d95bce1e334f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:16.825686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.825686 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.827424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1190/2459] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:16 2022] DELETE /identity/v3/projects/8fbbc26322b742c09eb9d95bce1e334f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:16.834525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:16.836166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:16.837695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f998b02c374b6f9a447b44ae70e405'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.846171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f998b02c374b6f9a447b44ae70e405'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.846971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f998b02c374b6f9a447b44ae70e405'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:16.910759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19965de-e745-4aa7-88da-711b8a5cf281 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:16.916655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:16.917822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:16.918102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:16.918374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] PATH_INFO: `/v3/users/8518d86250f54b18910e941f482e4b4a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:16.919536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8518d86250f54b18910e941f482e4b4a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:16.921711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:17.024508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c0bfc5bb-a7c2-4b8e-b73c-24f10702c097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f998b02c374b6f9a447b44ae70e405'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:17.033058 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1270/2460] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:16 2022] DELETE /identity/v3/users/b0f998b02c374b6f9a447b44ae70e405 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:17.039295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:17.039901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:17.039901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:17.069335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:17.070557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:17.131408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1271/2461] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:17.141707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:17.143089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:17.206260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58413-644c-4662-bc8c-83eb8f9159bc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:17.206771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8518d86250f54b18910e941f482e4b4a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:17.207458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8518d86250f54b18910e941f482e4b4a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:17.210329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:17.210937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:17.211222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:17.211504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:17.220563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8518d86250f54b18910e941f482e4b4a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:17.221344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:17.222798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:17.227943 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8518d86250f54b18910e941f482e4b4a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:17.228689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8518d86250f54b18910e941f482e4b4a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:17.239228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1272/2462] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:17.294738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:17.355972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1191/2463] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:16 2022] DELETE /identity/v3/users/8518d86250f54b18910e941f482e4b4a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:17.851913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:17.853461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:17.867686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcd4a2-4f4d-4437-897b-efe269ac3d74 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:17.945354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:17.946071 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:17.946276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:17.946573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] PATH_INFO: `/v3/projects/09ca2efcf7d744afb7730c7dc08faa35` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:17.947793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ca2efcf7d744afb7730c7dc08faa35)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:17.950347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:18.020490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:18.022021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:18.042134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43388aee-0777-4d6d-a942-4b19646fbb46 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:18.047982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:18.049323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.049683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.050380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] PATH_INFO: `/v3/projects/ae7be83e6cfa4bec9c962b553a7569bd` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.052272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7be83e6cfa4bec9c962b553a7569bd)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:18.054795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:18.161000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ca2efcf7d744afb7730c7dc08faa35', 'request_id': 'req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.241309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7be83e6cfa4bec9c962b553a7569bd', 'request_id': 'req-5a23780a-a063-430d-b6f7-7fc3b233ba54'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.274511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ca2efcf7d744afb7730c7dc08faa35', 'request_id': 'req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.281530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ca2efcf7d744afb7730c7dc08faa35', 'request_id': 'req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.292359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] The token cache is being invalidate because project 09ca2efcf7d744afb7730c7dc08faa35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:18.292655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.293369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.294901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1273/2464] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:17 2022] DELETE /identity/v3/projects/09ca2efcf7d744afb7730c7dc08faa35 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:18.298809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:18.300226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:18.364441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b99a57-d4ad-4cc3-856b-3ae7aedfbfac admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:18.427512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:18.428149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.428432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.428705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] PATH_INFO: `/v3/users/7e3381eb5a8545b18c8bd18e448484cb` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.429883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3381eb5a8545b18c8bd18e448484cb)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:18.431862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:18.469750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7be83e6cfa4bec9c962b553a7569bd', 'request_id': 'req-5a23780a-a063-430d-b6f7-7fc3b233ba54'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.476920 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7be83e6cfa4bec9c962b553a7569bd', 'request_id': 'req-5a23780a-a063-430d-b6f7-7fc3b233ba54'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.488979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] The token cache is being invalidate because project ae7be83e6cfa4bec9c962b553a7569bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:18.489397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.489955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5a23780a-a063-430d-b6f7-7fc3b233ba54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.491469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1192/2465] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:18 2022] DELETE /identity/v3/projects/ae7be83e6cfa4bec9c962b553a7569bd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:18.498414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e551-e389-426d-9717-eee3aa8654ee None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.498715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e551-e389-426d-9717-eee3aa8654ee None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.499004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e551-e389-426d-9717-eee3aa8654ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.519365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:18.520227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-38d9e551-e389-426d-9717-eee3aa8654ee None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:18.521488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-38d9e551-e389-426d-9717-eee3aa8654ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:18.529885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1193/2466] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:18.538829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.539239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.539544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.564946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:18.566412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:18.576940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1194/2467] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:18.581517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:18.591007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95a7fa-440a-4247-ad6a-d6e2f4a95fc7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:18.596394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:18.597118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.597589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.597953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.598832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:18.599243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:18.600986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:18.616246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1195/2468] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:39:18.619779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:18.630462 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e21d6-7c88-4f7f-ad85-d6591a314f86 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:18.637421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:18.638089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.638771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.638771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.639291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:18.641252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:18.779694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1196/2469] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:18 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:18.780716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:18.858542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc788a-22ac-4525-88ed-c06e349ffa20 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:18.865898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:18.866524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:18.866807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:18.867089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:18.867740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:18.869830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:18.960486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3381eb5a8545b18c8bd18e448484cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.975131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3381eb5a8545b18c8bd18e448484cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.987163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3381eb5a8545b18c8bd18e448484cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:18.988408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3381eb5a8545b18c8bd18e448484cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:19.040780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1197/2470] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:18 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:19.048161 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:19.059379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d2f9d-b368-4795-bcb5-1986f6887c1d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:19.065022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:19.066069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:19.066623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:19.067256 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:19.068423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:19.071582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:19.085430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1198/2471] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:19.090138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:19.102629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaec4f-5c4b-4a8e-8642-83cd47d4295a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:19.108434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:19.114054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:19.114054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:19.114054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:19.114054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:19.114054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:19.125254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1199/2472] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:19.129235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:19.140527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34622a-fe0c-40d1-996c-cbc383377217 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:19.145678 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:19.146323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:19.146601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:19.146882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] PATH_INFO: `/v3/projects/824cfbe714a2407fbe8c90f9272cea7f/users/7657739ecae14e47ac64e90a998298d3/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:19.163448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824cfbe714a2407fbe8c90f9272cea7f, user_id=7657739ecae14e47ac64e90a998298d3, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:19.166323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:19.195353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ff494e9-bbb5-4d7e-b8b3-55abbe44479f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3381eb5a8545b18c8bd18e448484cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:19.203214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1274/2473] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:18 2022] DELETE /identity/v3/users/7e3381eb5a8545b18c8bd18e448484cb => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:19.294985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1200/2474] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:19 2022] PUT /identity/v3/projects/824cfbe714a2407fbe8c90f9272cea7f/users/7657739ecae14e47ac64e90a998298d3/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:19.307640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:19.308694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:19.309666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:19.348947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] MFA Rules not processed for user `7657739ecae14e47ac64e90a998298d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:19.350202 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:19.441700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1275/2475] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:19.459182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:19.461783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:19.531164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971feb-dfb6-40b7-b3b0-3d143b413b79 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:19.536538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45ef1-4b44-46d3-8cf1-c09db55b1e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:19.537265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45ef1-4b44-46d3-8cf1-c09db55b1e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:19.537548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45ef1-4b44-46d3-8cf1-c09db55b1e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:19.537822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45ef1-4b44-46d3-8cf1-c09db55b1e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:19.549986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb45ef1-4b44-46d3-8cf1-c09db55b1e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:19.550434 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb45ef1-4b44-46d3-8cf1-c09db55b1e8f service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:19.563231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1201/2476] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:19.857093 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:19.858108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:19.954924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea7bb-c3c7-4e7b-bbdc-7a9bcd30ff26 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:19.960132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:19.960894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:19.961478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:19.961478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] PATH_INFO: `/v3/projects/74dd10cbd9ef4863bd54ef42dc2a943d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:19.962748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dd10cbd9ef4863bd54ef42dc2a943d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:19.965349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:20.133182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dd10cbd9ef4863bd54ef42dc2a943d', 'request_id': 'req-9f15e13d-d3f1-44bc-9750-2250fefe6999'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:20.309847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dd10cbd9ef4863bd54ef42dc2a943d', 'request_id': 'req-9f15e13d-d3f1-44bc-9750-2250fefe6999'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:20.322095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dd10cbd9ef4863bd54ef42dc2a943d', 'request_id': 'req-9f15e13d-d3f1-44bc-9750-2250fefe6999'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:20.340977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] The token cache is being invalidate because project 74dd10cbd9ef4863bd54ef42dc2a943d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:20.341444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:20.342641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9f15e13d-d3f1-44bc-9750-2250fefe6999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:20.371416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1276/2477] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:19 2022] DELETE /identity/v3/projects/74dd10cbd9ef4863bd54ef42dc2a943d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:20.377158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:20.377450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:20.377729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:20.406191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:20.407422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:20.485264 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1202/2478] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:20.493483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:20.494106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:20.508501 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:20.531725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:20.533008 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:20.546157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1277/2479] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:20.550670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:20.563938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de3f4-f027-4ecd-acbc-b0c020664528 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:20.569179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:20.600254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:20.600254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:20.600254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:20.600254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:20.600254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:20.600254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:20.600846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1203/2480] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:20.603254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:20.613437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51d6e-f126-4a21-b329-9f2213894f13 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:20.621127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:20.621806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:20.622019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:20.622322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:20.622941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:20.625056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:20.956943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1278/2481] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:20 2022] POST /identity/v3/projects => generated 377 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:20.969663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:20.986318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b6f0-47af-48b3-a759-ff46ec66e360 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:21.019237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:21.021611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:21.079749 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:21.080353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.080624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.081622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.081622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:21.083584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:21.101838 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ae5a-dc20-41dd-b30f-fc14948ae6b0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:21.107810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:21.108726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.109153 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.109519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] PATH_INFO: `/v3/users/227045489aeb4a07b37d00507de0d7f5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.110881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=227045489aeb4a07b37d00507de0d7f5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:21.112835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:21.333151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1204/2482] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:20 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:21.341210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:21.354822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead563a-4ce1-42bb-b683-c31772d0facf admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:21.365904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:21.366702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.367073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.367441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.368317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:21.371032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:21.384196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1205/2483] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:21.390232 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:21.404873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308834-7ae7-40cb-b886-3421eb3ee2d5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:21.412135 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:21.413113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.413570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.414032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.415240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:21.418890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:21.440910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1206/2484] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:21.446157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:21.458174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9dd6c-81c8-4d1a-acc4-547a03890a36 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:21.463526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c059c-dd3b-438e-a353-5672b50daa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:21.464134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c059c-dd3b-438e-a353-5672b50daa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.464406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c059c-dd3b-438e-a353-5672b50daa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.464888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c059c-dd3b-438e-a353-5672b50daa50 admin admin] PATH_INFO: `/v3/projects/9867229849bb4e2ca25328de8afd49b4/users/e7f2938ce4794aa8ab9f153c72a6fc54/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.482933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c059c-dd3b-438e-a353-5672b50daa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9867229849bb4e2ca25328de8afd49b4, user_id=e7f2938ce4794aa8ab9f153c72a6fc54, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:21.496064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c059c-dd3b-438e-a353-5672b50daa50 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:21.631280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227045489aeb4a07b37d00507de0d7f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:21.646621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227045489aeb4a07b37d00507de0d7f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:21.659161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227045489aeb4a07b37d00507de0d7f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:21.662152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227045489aeb4a07b37d00507de0d7f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:21.681563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1207/2485] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:21 2022] PUT /identity/v3/projects/9867229849bb4e2ca25328de8afd49b4/users/e7f2938ce4794aa8ab9f153c72a6fc54/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:21.684218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30348df3-e57a-4e36-89a1-a0bdf4e2ab17 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.695953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30348df3-e57a-4e36-89a1-a0bdf4e2ab17 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.695953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30348df3-e57a-4e36-89a1-a0bdf4e2ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.708094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-30348df3-e57a-4e36-89a1-a0bdf4e2ab17 None None] MFA Rules not processed for user `9214312ee30a41e085e9038be016b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:21.709439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-30348df3-e57a-4e36-89a1-a0bdf4e2ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:21.780534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1208/2486] 10.222.0.76 () {58 vars in 967 bytes} [Wed Aug 31 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:21.781766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba767-ed04-4eec-bef7-e75b02f20d52 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.782057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba767-ed04-4eec-bef7-e75b02f20d52 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.782336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba767-ed04-4eec-bef7-e75b02f20d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.813538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7aaba767-ed04-4eec-bef7-e75b02f20d52 None None] MFA Rules not processed for user `e7f2938ce4794aa8ab9f153c72a6fc54`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:21.814762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7aaba767-ed04-4eec-bef7-e75b02f20d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:21.858574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227045489aeb4a07b37d00507de0d7f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:21.862679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:21.865243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1279/2487] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:21 2022] DELETE /identity/v3/users/227045489aeb4a07b37d00507de0d7f5 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:21.866190 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:21.867779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:21.902329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1209/2488] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:21.903725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.904021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.904321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.925468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:21.926737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:21.951958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3535-ea4c-4f25-a892-3bddccd7bc6e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:21.957666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7266140e48e4588a147704a0b83bb21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:21.963742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:21.963742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:21.963742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:21.963742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:22.000387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1210/2489] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:22.002772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.010060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:22.027101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334582c-0ac5-4a12-8b6f-647c5feacd9d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.032287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.032903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.033190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.033468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.034129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.036044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.044412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.046218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.056030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1280/2490] 10.222.0.76 () {60 vars in 1384 bytes} [Wed Aug 31 19:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:39:22.056712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.058856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:22.131524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9bdc-1650-4903-ad6e-700796cd40fe service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.135542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.137017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.137299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.137577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.147809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.149302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.159577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1281/2491] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:22.197622 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1211/2492] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:22.205674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.219290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b27ac-5351-4236-abb4-e6669ee2fcc3 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.310378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.311634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.312217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.312789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.314135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.317228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.537811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1282/2493] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:22 2022] POST /identity/v3/users => generated 295 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:22.541612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.553584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6e71a-35c5-4591-9004-ba36ad038ca0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.558858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.559484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.559767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.560044 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.560917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.562597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.577737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1212/2494] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:22.580965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.596377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282a205-8f91-4bf9-8534-1f1d89ab54fc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.601922 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.602607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.602892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.603168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] PATH_INFO: `/v3/projects/1793961bf1ac439d96218632812df29a/users/c843046889044c2783f6ee99f4c94de0/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.622287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1793961bf1ac439d96218632812df29a, user_id=c843046889044c2783f6ee99f4c94de0, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.625323 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.800338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1283/2495] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:22 2022] PUT /identity/v3/projects/1793961bf1ac439d96218632812df29a/users/c843046889044c2783f6ee99f4c94de0/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:22.801500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.801662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.803911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:22.819648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63a22f-896a-4400-9c79-e1914f13236b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.885534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100908a-7fa4-465a-a27a-a2d294a73930 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.893193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.893888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.893998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.897160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.897160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.897160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.915104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1284/2496] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:22.919999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:22.932557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.933542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.933902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.934102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee8ad-1e79-42e9-92ae-c21bc6ec4da5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:22.934314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] PATH_INFO: `/v3/projects/2cf9220cb80946c9bfd894fc53cdd949` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.936532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf9220cb80946c9bfd894fc53cdd949)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.938046 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.942102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaa939-d6af-4314-89e0-061773c68ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:22.942858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa939-d6af-4314-89e0-061773c68ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.943132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa939-d6af-4314-89e0-061773c68ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.943678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa939-d6af-4314-89e0-061773c68ec1 admin admin] PATH_INFO: `/v3/projects/1793961bf1ac439d96218632812df29a/users/c843046889044c2783f6ee99f4c94de0/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:22.948864 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaa939-d6af-4314-89e0-061773c68ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1793961bf1ac439d96218632812df29a, user_id=c843046889044c2783f6ee99f4c94de0, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:22.958890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaa939-d6af-4314-89e0-061773c68ec1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:22.975507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1285/2497] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:22 2022] PUT /identity/v3/projects/1793961bf1ac439d96218632812df29a/users/c843046889044c2783f6ee99f4c94de0/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:22.987214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:22.988047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:22.988047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:23.034561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] MFA Rules not processed for user `c843046889044c2783f6ee99f4c94de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:23.036344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:23.076718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:23.121904 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1286/2498] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:23.140308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:23.142849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:23.176062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf9220cb80946c9bfd894fc53cdd949', 'request_id': 'req-43a569e4-bca2-47d6-bc89-2783eae496f1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:23.213144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f127-506f-4b61-9ab4-e645defd9b14 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:23.271975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960250a-ec88-4613-b06e-89d151feb5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:23.272736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960250a-ec88-4613-b06e-89d151feb5ca service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:23.272997 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960250a-ec88-4613-b06e-89d151feb5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:23.273277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960250a-ec88-4613-b06e-89d151feb5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:23.354750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960250a-ec88-4613-b06e-89d151feb5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:23.357314 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960250a-ec88-4613-b06e-89d151feb5ca service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:23.371056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1287/2499] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:23.380883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf9220cb80946c9bfd894fc53cdd949', 'request_id': 'req-43a569e4-bca2-47d6-bc89-2783eae496f1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:23.389669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf9220cb80946c9bfd894fc53cdd949', 'request_id': 'req-43a569e4-bca2-47d6-bc89-2783eae496f1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:23.404090 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] The token cache is being invalidate because project 2cf9220cb80946c9bfd894fc53cdd949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:23.404475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:23.405425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-43a569e4-bca2-47d6-bc89-2783eae496f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:23.412126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1213/2500] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:22 2022] DELETE /identity/v3/projects/2cf9220cb80946c9bfd894fc53cdd949 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:23.414285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:23.414794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:23.414969 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:23.470778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:23.473399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:23.601305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1288/2501] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:23.610691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:23.611183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:23.611646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:23.642139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:23.643386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:23.652215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1214/2502] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:23.656567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:23.666903 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4c9a-0d6c-4508-9c79-055d7e9f1bb5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:23.671992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:23.672604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:23.672925 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:23.673203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:23.673859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:23.674168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:23.675766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:23.687973 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1289/2503] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:23.692655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:23.703276 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a927614-0045-46fa-9ef2-526f15c93110 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:23.710934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:23.710934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:23.710934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:23.711411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:23.712605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:23.716346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:23.934045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1215/2504] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:23 2022] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:23.938561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:23.953281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba2e3e-3076-4430-9887-7a22cafa7863 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:24.022446 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:24.023052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:24.023338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:24.023718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:24.024416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:24.026420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:24.196891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1290/2505] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:23 2022] POST /identity/v3/users => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:24.202515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:24.214149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743e32-613f-4eb4-af5f-b72165808435 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:24.223107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:24.224108 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:24.224489 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:24.224902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:24.225669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:24.243261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:24.288895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1216/2506] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:24.290779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:24.326431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937de0a-188f-4209-8536-499877b646c0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:24.337267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796e7a-dd31-4311-9384-64c2d3589e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:24.338178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796e7a-dd31-4311-9384-64c2d3589e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:24.338619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796e7a-dd31-4311-9384-64c2d3589e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:24.339101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796e7a-dd31-4311-9384-64c2d3589e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:24.339948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796e7a-dd31-4311-9384-64c2d3589e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:24.341911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796e7a-dd31-4311-9384-64c2d3589e1b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:24.379380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1291/2507] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:24.380427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:24.393823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9dcd-94f2-46be-98fb-63c6f2b8fdb7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:24.401028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:24.402096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:24.402514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:24.402988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] PATH_INFO: `/v3/projects/aa6fd8fd64e1473384c6f73ba3a01d69/users/f56f624206f74e6893046c91ab71b218/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:24.442946 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6fd8fd64e1473384c6f73ba3a01d69, user_id=f56f624206f74e6893046c91ab71b218, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:24.446812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:24.853005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1217/2508] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:24 2022] PUT /identity/v3/projects/aa6fd8fd64e1473384c6f73ba3a01d69/users/f56f624206f74e6893046c91ab71b218/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:24.860410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:24.860851 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:24.861444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:24.924759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:24.927632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:25.075129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1292/2509] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:25.092268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:25.095516 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:25.226390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e022e5-e649-4817-8392-a4559ddcfc9e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:25.233186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a78c33-f16f-4328-844a-9bd2495c7832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:25.233917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a78c33-f16f-4328-844a-9bd2495c7832 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:25.234148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a78c33-f16f-4328-844a-9bd2495c7832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:25.234398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a78c33-f16f-4328-844a-9bd2495c7832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:25.250320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a78c33-f16f-4328-844a-9bd2495c7832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:25.253871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a78c33-f16f-4328-844a-9bd2495c7832 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:25.277781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1218/2510] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:27.168592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:27.171194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:27.243345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46e43-1d59-44f4-aa92-0fb19cb67366 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:27.249796 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:27.251259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:27.251715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:27.252176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:27.254462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:27.338595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:27.350300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:27.351991 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:27.363368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1293/2511] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:27.768677 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:27.768994 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:27.769403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:27.816695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] MFA Rules not processed for user `f56f624206f74e6893046c91ab71b218`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:27.817151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:27.929542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1219/2512] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:27.935213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:27.950561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369ee06-8c26-4a2b-9707-aa04931409f2 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:27.956951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:27.957820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:27.958311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:27.958786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:27.963470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:27.966538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:28.196669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1294/2513] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:27 2022] POST /identity/v3/projects => generated 403 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:28.198719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:28.211840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d7ad-71f3-4908-8c39-80cd513d49e6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:28.291246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:28.292242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:28.292526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:28.292827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:28.293481 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:28.295436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:28.520004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1220/2514] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:28 2022] POST /identity/v3/users => generated 308 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:28.524067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:28.535205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be3a4-b6da-468e-a359-f57db3f52b0a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:28.540496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:28.541869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:28.542160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:28.542441 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:28.543222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:28.545599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:28.565139 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1295/2515] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:28.569070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:28.583217 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69348ed3-8130-428f-b20d-656407113bdd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:28.589594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:28.590290 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:28.590571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:28.590845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] PATH_INFO: `/v3/projects/3bb89f6be506472eb3c684f9f725d009/users/0b47b2932ce1420aadc2f1f2e1fa8909/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:28.615852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb89f6be506472eb3c684f9f725d009, user_id=0b47b2932ce1420aadc2f1f2e1fa8909, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:28.619689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:28.785277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1221/2516] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:28 2022] PUT /identity/v3/projects/3bb89f6be506472eb3c684f9f725d009/users/0b47b2932ce1420aadc2f1f2e1fa8909/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:28.790729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:28.809404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d35e6-205c-4646-ab5f-6b6623ba684e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:28.897147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:28.897995 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:28.898272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:28.898828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:28.899334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:28.900937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:28.912029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1296/2517] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:28.918269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:28.920638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:28.934216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb9c06-0dd2-4033-adba-baf8b701a90e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:28.939742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2dc23-10f4-4915-98c1-9cdc7c0113e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:28.940408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2dc23-10f4-4915-98c1-9cdc7c0113e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:28.940688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2dc23-10f4-4915-98c1-9cdc7c0113e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:28.940995 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2dc23-10f4-4915-98c1-9cdc7c0113e1 admin admin] PATH_INFO: `/v3/projects/3bb89f6be506472eb3c684f9f725d009/users/0b47b2932ce1420aadc2f1f2e1fa8909/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:28.943123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2dc23-10f4-4915-98c1-9cdc7c0113e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb89f6be506472eb3c684f9f725d009, user_id=0b47b2932ce1420aadc2f1f2e1fa8909, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:28.945744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2dc23-10f4-4915-98c1-9cdc7c0113e1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:28.961858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1222/2518] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:28 2022] PUT /identity/v3/projects/3bb89f6be506472eb3c684f9f725d009/users/0b47b2932ce1420aadc2f1f2e1fa8909/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:31.138881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:31.731775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:31.832103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:31.832775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:31.833249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:31.865237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8fbb5-183c-4cee-9fa3-fc98a01e95e0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:31.878249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] MFA Rules not processed for user `0b47b2932ce1420aadc2f1f2e1fa8909`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:31.879530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:31.941647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:31.942805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:31.943481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:31.944126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:31.948977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:31.976035 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1223/2519] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:32.080179 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:32.081772 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:32.111747 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1297/2520] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:33.046366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:33.160464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:34.064103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:34.077719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa6e5-90d5-4842-832d-8623cb2fe70b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:34.083723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:34.084545 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:34.084998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:34.085380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] PATH_INFO: `/v3/users/f56f624206f74e6893046c91ab71b218` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:34.086748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56f624206f74e6893046c91ab71b218)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:34.089373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:34.291347 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:34.293352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:34.308041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7279cb0-f507-420c-8a07-ed42711d8551 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:34.321026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:34.322404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:34.323616 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:34.324185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] PATH_INFO: `/v3/users/e7f2938ce4794aa8ab9f153c72a6fc54` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:34.325983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f2938ce4794aa8ab9f153c72a6fc54)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:34.328596 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:34.427454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56f624206f74e6893046c91ab71b218'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.429281 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56f624206f74e6893046c91ab71b218'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.446076 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56f624206f74e6893046c91ab71b218'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.459913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56f624206f74e6893046c91ab71b218'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.462230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-568b9488-1cc0-4671-9ba5-c20bf6ca9a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56f624206f74e6893046c91ab71b218'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.597245 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1224/2521] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:34 2022] DELETE /identity/v3/users/f56f624206f74e6893046c91ab71b218 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:34.689135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f2938ce4794aa8ab9f153c72a6fc54'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.707289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f2938ce4794aa8ab9f153c72a6fc54'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.722730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f2938ce4794aa8ab9f153c72a6fc54'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.723623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f2938ce4794aa8ab9f153c72a6fc54'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.930800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f2938ce4794aa8ab9f153c72a6fc54'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:34.941000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1298/2522] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:34 2022] DELETE /identity/v3/users/e7f2938ce4794aa8ab9f153c72a6fc54 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:34.944424 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:34.944719 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:34.945144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:34.982071 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:34.983935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:34.986514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:34.987735 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:35.073987 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1225/2523] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:35.084991 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:35.086658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:35.093488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efabe89-9dc9-4ac2-ab7c-619cea0ef577 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:35.099164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:35.100064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:35.100546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:35.100847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] PATH_INFO: `/v3/projects/aa6fd8fd64e1473384c6f73ba3a01d69` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:35.102300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6fd8fd64e1473384c6f73ba3a01d69)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:35.105199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:35.163292 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6196cb-1c2a-4d2c-bec3-e821cf3ad371 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:35.168947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:35.169417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:35.169703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:35.169977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:35.184465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:35.185908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:35.197482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1226/2524] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:35.294212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6fd8fd64e1473384c6f73ba3a01d69', 'request_id': 'req-0e8e8152-b780-490b-8dc7-114a1fed19e0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:35.440684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6fd8fd64e1473384c6f73ba3a01d69', 'request_id': 'req-0e8e8152-b780-490b-8dc7-114a1fed19e0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:35.451741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6fd8fd64e1473384c6f73ba3a01d69', 'request_id': 'req-0e8e8152-b780-490b-8dc7-114a1fed19e0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:35.493275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] The token cache is being invalidate because project aa6fd8fd64e1473384c6f73ba3a01d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:35.493986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:35.495587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:35.504338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1299/2525] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:34 2022] DELETE /identity/v3/projects/aa6fd8fd64e1473384c6f73ba3a01d69 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:35.505762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:35.528147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a5f1-9dfe-4ca4-928c-f93a9621fbaf service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:35.649366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:35.652028 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:35.653273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:35.654664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] PATH_INFO: `/v3/users/0b47b2932ce1420aadc2f1f2e1fa8909` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:35.656125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b47b2932ce1420aadc2f1f2e1fa8909)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:35.670085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:36.103245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:36.105769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:36.129389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8152-b780-490b-8dc7-114a1fed19e0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:36.136333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:36.137295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:36.137895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:36.138337 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] PATH_INFO: `/v3/projects/9867229849bb4e2ca25328de8afd49b4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:36.139818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9867229849bb4e2ca25328de8afd49b4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:36.142199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:36.155710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b47b2932ce1420aadc2f1f2e1fa8909'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.158167 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b47b2932ce1420aadc2f1f2e1fa8909'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.181356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b47b2932ce1420aadc2f1f2e1fa8909'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.200328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:36.202490 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b47b2932ce1420aadc2f1f2e1fa8909'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.203875 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b47b2932ce1420aadc2f1f2e1fa8909'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.304493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9867229849bb4e2ca25328de8afd49b4', 'request_id': 'req-513154af-f6c3-4c6e-9422-c84f1019f060'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.324738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:36.343301 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1227/2526] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:35 2022] DELETE /identity/v3/users/0b47b2932ce1420aadc2f1f2e1fa8909 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:36.513271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9867229849bb4e2ca25328de8afd49b4', 'request_id': 'req-513154af-f6c3-4c6e-9422-c84f1019f060'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.527970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9867229849bb4e2ca25328de8afd49b4', 'request_id': 'req-513154af-f6c3-4c6e-9422-c84f1019f060'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.546183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] The token cache is being invalidate because project 9867229849bb4e2ca25328de8afd49b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:36.548846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.550642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.555601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1300/2527] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:36 2022] DELETE /identity/v3/projects/9867229849bb4e2ca25328de8afd49b4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:36.565211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:36.566616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:36.648518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567798-e2f1-4477-9295-0765eb31c79c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:36.653886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:36.654569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:36.654849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:36.655125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] PATH_INFO: `/v3/users/c843046889044c2783f6ee99f4c94de0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:36.656303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c843046889044c2783f6ee99f4c94de0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:36.658272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:36.690119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:36.692160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:36.768010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513154af-f6c3-4c6e-9422-c84f1019f060 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:36.773213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:36.774027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:36.774774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:36.774774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] PATH_INFO: `/v3/projects/3bb89f6be506472eb3c684f9f725d009` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:36.776197 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb89f6be506472eb3c684f9f725d009)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:36.778306 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:36.963511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb89f6be506472eb3c684f9f725d009', 'request_id': 'req-3ede5956-6436-453e-9d37-a52d9be223a7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.976455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c843046889044c2783f6ee99f4c94de0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.977237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c843046889044c2783f6ee99f4c94de0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:36.999435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c843046889044c2783f6ee99f4c94de0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.015882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c843046889044c2783f6ee99f4c94de0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.016772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-86e34ffa-d80a-4cbe-91f4-8f4b3be9e401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c843046889044c2783f6ee99f4c94de0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.039193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb89f6be506472eb3c684f9f725d009', 'request_id': 'req-3ede5956-6436-453e-9d37-a52d9be223a7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.047663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb89f6be506472eb3c684f9f725d009', 'request_id': 'req-3ede5956-6436-453e-9d37-a52d9be223a7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.059641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] The token cache is being invalidate because project 3bb89f6be506472eb3c684f9f725d009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:37.059859 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.060531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ede5956-6436-453e-9d37-a52d9be223a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.071984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1301/2528] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:36 2022] DELETE /identity/v3/projects/3bb89f6be506472eb3c684f9f725d009 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:37.073646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.074105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.074734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.132143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:37.133422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:37.157203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1228/2529] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:36 2022] DELETE /identity/v3/users/c843046889044c2783f6ee99f4c94de0 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:37.203354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1302/2530] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:37.211409 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.211637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.211952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.232944 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:37.234153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:37.296321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1229/2531] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:37.300926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.318610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7395bc-46f4-4c6e-be1a-4a91836311eb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:37.319932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.322486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:37.325099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:37.326067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.326614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.327765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.328865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:37.329282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:37.331858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:37.355171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1303/2532] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:37.360566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.361055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59977f-25fb-4243-a92a-70f021b66b68 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:37.368478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:37.369909 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.370210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.370595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] PATH_INFO: `/v3/users/15d9acdceb67456591d0ed24ed4e7fc1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.371968 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d9acdceb67456591d0ed24ed4e7fc1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:37.374460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:37.382151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db2894-48df-4517-90e6-bb3f74be7437 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:37.390572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:37.391848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.392362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.392898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.394030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:37.396852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:37.610753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1304/2533] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:37 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:37.624546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.710552 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2456cd-9fe5-44b8-b883-1e2451b522bc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:37.717497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:37.721481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.722738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.723047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.727517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:37.732433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:37.755983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d9acdceb67456591d0ed24ed4e7fc1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.756610 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d9acdceb67456591d0ed24ed4e7fc1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.785637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d9acdceb67456591d0ed24ed4e7fc1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.793916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d9acdceb67456591d0ed24ed4e7fc1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.794765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d9acdceb67456591d0ed24ed4e7fc1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:37.847500 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1305/2534] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:37 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:37.851684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.853538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:37.867682 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc766-ae47-4b01-86c5-6f646c7405fb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:37.882904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1230/2535] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:37 2022] DELETE /identity/v3/users/15d9acdceb67456591d0ed24ed4e7fc1 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:37.884551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:37.886185 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:37.886874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:37.887311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:37.888123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:37.890582 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:37.905381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1306/2536] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:37.909145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.909313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:37.910597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:37.920255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48c5b-81bb-4750-90c5-916a2cc2e859 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:38.034936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50359e20-397c-4230-985e-cedfba0df074 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:38.041422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:38.041655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.041884 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.042340 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] PATH_INFO: `/v3/projects/1793961bf1ac439d96218632812df29a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.043514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1793961bf1ac439d96218632812df29a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:38.046029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:38.061872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:38.065135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.065546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.066040 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.067542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:38.069338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:38.086205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1307/2537] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:38.087421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:38.089510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:38.119063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182d2e8-79c7-4d69-87de-0f2edbd50fd0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:38.128705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:38.129757 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.130191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.132117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] PATH_INFO: `/v3/users/7657739ecae14e47ac64e90a998298d3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.134830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7657739ecae14e47ac64e90a998298d3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:38.139181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:38.208437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1793961bf1ac439d96218632812df29a', 'request_id': 'req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.297630 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1793961bf1ac439d96218632812df29a', 'request_id': 'req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.311041 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1793961bf1ac439d96218632812df29a', 'request_id': 'req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.329470 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] The token cache is being invalidate because project 1793961bf1ac439d96218632812df29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:38.329893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.330954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.332552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1231/2538] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:37 2022] DELETE /identity/v3/projects/1793961bf1ac439d96218632812df29a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:38.333658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:38.335150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:38.340675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:38.415508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e4278-e6f9-4f5f-885a-f16bab8bcbad admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:38.420936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:38.422392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.422684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.423176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] PATH_INFO: `/v3/projects/a932a4420041423cb195a24ff6e86bc0/users/68d475bf67594f38ba5ec861aab53452/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.439825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a932a4420041423cb195a24ff6e86bc0, user_id=68d475bf67594f38ba5ec861aab53452, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:38.449952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:38.450919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7657739ecae14e47ac64e90a998298d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.463389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7657739ecae14e47ac64e90a998298d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.470884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7657739ecae14e47ac64e90a998298d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.471658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7657739ecae14e47ac64e90a998298d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.480827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:38.680697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1232/2539] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:38 2022] PUT /identity/v3/projects/a932a4420041423cb195a24ff6e86bc0/users/68d475bf67594f38ba5ec861aab53452/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:38.681449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:38.683206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:38.715810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de7c13f5-c53e-4865-8563-33f88c769ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7657739ecae14e47ac64e90a998298d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:38.725696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1308/2540] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:38 2022] DELETE /identity/v3/users/7657739ecae14e47ac64e90a998298d3 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:38.727283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4813-946b-4360-afbc-29791e347694 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.727752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4813-946b-4360-afbc-29791e347694 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.728253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4813-946b-4360-afbc-29791e347694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.752092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cc4a4813-946b-4360-afbc-29791e347694 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:38.753438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc4a4813-946b-4360-afbc-29791e347694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:38.770680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c278b-6236-424d-9a07-3f2d9346816a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:38.825732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1309/2541] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:38.827483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.827819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.828096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.839478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:38.840454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.840738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.841048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] PATH_INFO: `/v3/projects/1dc2d9cbb760404dafa4282865bb9b11` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.842234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc2d9cbb760404dafa4282865bb9b11)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:38.844534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:38.864643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] MFA Rules not processed for user `68d475bf67594f38ba5ec861aab53452`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:38.865929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:38.938690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1310/2542] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:38.939473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:38.940970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:38.956408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e5bf-edf4-4e3f-b2d1-c8aef6ad4df6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:38.963789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:38.963789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:38.963789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:38.963789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] PATH_INFO: `/v3/users/76a42ecd5a0b4058ab1192e8a019e087` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:38.965117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a42ecd5a0b4058ab1192e8a019e087)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:38.967092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:39.048152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc2d9cbb760404dafa4282865bb9b11', 'request_id': 'req-723dc89c-c7fb-4c67-b87c-69b74ae11556'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.256224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc2d9cbb760404dafa4282865bb9b11', 'request_id': 'req-723dc89c-c7fb-4c67-b87c-69b74ae11556'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.264705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc2d9cbb760404dafa4282865bb9b11', 'request_id': 'req-723dc89c-c7fb-4c67-b87c-69b74ae11556'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.276637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] The token cache is being invalidate because project 1dc2d9cbb760404dafa4282865bb9b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:39.276954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.277624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-723dc89c-c7fb-4c67-b87c-69b74ae11556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.279169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1233/2543] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:38 2022] DELETE /identity/v3/projects/1dc2d9cbb760404dafa4282865bb9b11 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:39.280368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3628fb-b071-483f-ba9f-84e232cb4875 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.280649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3628fb-b071-483f-ba9f-84e232cb4875 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.280967 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3628fb-b071-483f-ba9f-84e232cb4875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.299895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6d3628fb-b071-483f-ba9f-84e232cb4875 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:39.301186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6d3628fb-b071-483f-ba9f-84e232cb4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.375209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1234/2544] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:39.376499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.376787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.377093 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.399566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:39.400853 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.409596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1235/2545] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:39.410399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:39.411743 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.428057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9153c-302a-47d4-b5d6-a9cdfa69f54c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:39.431289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a42ecd5a0b4058ab1192e8a019e087'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.434755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:39.435332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.435613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.435880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.436520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:39.438642 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:39.453340 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a42ecd5a0b4058ab1192e8a019e087'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.460208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a42ecd5a0b4058ab1192e8a019e087'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.464882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a42ecd5a0b4058ab1192e8a019e087'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.640548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a42ecd5a0b4058ab1192e8a019e087'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:39.647604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1311/2546] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:38 2022] DELETE /identity/v3/users/76a42ecd5a0b4058ab1192e8a019e087 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:39.651737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1236/2547] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:39 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:39.655813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:39.655935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:39.656022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.659182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.733512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97671b-b0fb-4c61-9658-1f56ad8377a4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:39.736033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e56dd3-6146-424c-8f01-8f4d67a46768 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:39.741588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:39.743580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.743580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.743580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.745349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.811414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:39.812548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.812835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.813333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] PATH_INFO: `/v3/users/a0d6de2005b84f48839cb2b9905fad83` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.814580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d6de2005b84f48839cb2b9905fad83)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:39.816719 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:39.828742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:39.830498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:39.843398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1237/2548] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:39.843636 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:39.846210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.860727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b85e-79c9-4f9b-aa63-489e88bc8b51 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:39.866414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:39.866656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.866978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.867573 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.867871 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:39.868180 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:39.870522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:39.883784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1238/2549] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:39.885000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:39.887193 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:39.901001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b082f2-e7a0-4bae-b108-d4aa5b44c118 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:39.905963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:39.906582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:39.906864 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:39.907162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:39.907818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:39.909797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:40.071887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1239/2550] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:39 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:40.076040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:40.081770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d6de2005b84f48839cb2b9905fad83'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.085056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720afca7-c59c-4179-9d3a-6ed9dd59fb30 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:40.093989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:40.094631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:40.094912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:40.095184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:40.095842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:40.097836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:40.110036 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d6de2005b84f48839cb2b9905fad83'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.122802 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d6de2005b84f48839cb2b9905fad83'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.123664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d6de2005b84f48839cb2b9905fad83'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.245186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1240/2551] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:40 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:40.246148 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:40.247892 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:40.278869 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d6de2005b84f48839cb2b9905fad83'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.286981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1312/2552] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:39 2022] DELETE /identity/v3/users/a0d6de2005b84f48839cb2b9905fad83 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:40.289386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:40.292560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:40.340013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab0577-c377-4346-b3dc-83495cd3a035 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:40.388318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92ac43-6bad-46d1-aa1c-1c6801cf7161 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:40.398764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:40.399287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:40.399444 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:40.399611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:40.400290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:40.402696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:40.415646 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1313/2553] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:40.417138 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:40.420690 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:40.436029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98105bab-be20-4b78-bade-fd359953ba7a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:40.443074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:40.445600 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:40.445917 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:40.446256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:40.446923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:40.449346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:40.452166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:40.452978 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:40.453471 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:40.454594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] PATH_INFO: `/v3/projects/0462d5672bf9479eb616fb5055e37b3e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:40.457557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0462d5672bf9479eb616fb5055e37b3e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:40.459683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:40.709267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1314/2554] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:40 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:40.713204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:40.715707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:40.722457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0462d5672bf9479eb616fb5055e37b3e', 'request_id': 'req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.730537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810c75-3ddc-437f-98c1-c6e5d6e55ba7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:40.766520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:40.793840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:40.794524 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:40.794812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:40.795660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] PATH_INFO: `/v3/projects/824cfbe714a2407fbe8c90f9272cea7f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:40.796368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=824cfbe714a2407fbe8c90f9272cea7f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:40.798425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:40.879643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0462d5672bf9479eb616fb5055e37b3e', 'request_id': 'req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.887534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0462d5672bf9479eb616fb5055e37b3e', 'request_id': 'req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.898668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] The token cache is being invalidate because project 0462d5672bf9479eb616fb5055e37b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:40.898972 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.899646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:40.902183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1241/2555] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:40 2022] DELETE /identity/v3/projects/0462d5672bf9479eb616fb5055e37b3e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:40.902557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:40.903923 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:40.919755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d332a8e-937b-4a1d-80c7-dc4c5b69c27a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:40.924734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:40.925559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:40.925850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:40.926155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] PATH_INFO: `/v3/projects/e52a1f1edf9d43cd94f91e6f2591d9d0/users/397fbb907cb240f88956568eb045e9a0/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:40.943130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52a1f1edf9d43cd94f91e6f2591d9d0, user_id=397fbb907cb240f88956568eb045e9a0, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:40.945893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.051669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1242/2556] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:40 2022] PUT /identity/v3/projects/e52a1f1edf9d43cd94f91e6f2591d9d0/users/397fbb907cb240f88956568eb045e9a0/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:41.053010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.054836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.060354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824cfbe714a2407fbe8c90f9272cea7f', 'request_id': 'req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.119182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714c597-9d60-489c-b1df-7ac8ca455e96 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.192204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.192204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.192204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.192204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.198182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.198182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.199986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824cfbe714a2407fbe8c90f9272cea7f', 'request_id': 'req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.207057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824cfbe714a2407fbe8c90f9272cea7f', 'request_id': 'req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.211956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1243/2557] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:41.212793 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.216244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.218637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] The token cache is being invalidate because project 824cfbe714a2407fbe8c90f9272cea7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:41.219052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.219822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c85caeb-1609-4a36-a14c-a1aa6b6320cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.226538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1315/2558] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:40 2022] DELETE /identity/v3/projects/824cfbe714a2407fbe8c90f9272cea7f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:41.226538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.226538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.226538 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.233624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceda8f1-8262-4f91-95f4-0bc89b83356f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.238849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.239641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.240054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.240338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] PATH_INFO: `/v3/projects/2d790b44d60e4bddad6661ef4eba1ecb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.241566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d790b44d60e4bddad6661ef4eba1ecb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.243530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.244998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:41.248890 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.256689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1316/2559] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:41.257678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.259128 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.272356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25e9cc-7f30-4b62-ac5e-34325f805a8f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.277225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.277833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.278116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.279339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.279339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.280629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.290764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1317/2560] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:41.292254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.294038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.316506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0869ec-8e1b-4a34-ab7a-370f29bb85b7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.324109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dfdc8-4658-4a16-bd1c-c9e70d3c8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.325061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfdc8-4658-4a16-bd1c-c9e70d3c8507 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.325494 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfdc8-4658-4a16-bd1c-c9e70d3c8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.325919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfdc8-4658-4a16-bd1c-c9e70d3c8507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.326916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dfdc8-4658-4a16-bd1c-c9e70d3c8507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.329547 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dfdc8-4658-4a16-bd1c-c9e70d3c8507 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.348953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1318/2561] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:41.350344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a7cb4-d714-449d-b403-31331f152d73 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.350631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a7cb4-d714-449d-b403-31331f152d73 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.351000 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a7cb4-d714-449d-b403-31331f152d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.372166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-332a7cb4-d714-449d-b403-31331f152d73 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:41.373652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-332a7cb4-d714-449d-b403-31331f152d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.391890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d790b44d60e4bddad6661ef4eba1ecb', 'request_id': 'req-98128037-9755-4837-921a-393c1dac11c6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.437320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1319/2562] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:41.438573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.438858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.439133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.458373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:41.459559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.471390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1320/2563] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:41.472294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.482604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b882d6-dfe6-4734-85ea-f84cb7eda26c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.487327 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.487961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.488240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.488512 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] PATH_INFO: `/v3/projects/e52a1f1edf9d43cd94f91e6f2591d9d0/users/397fbb907cb240f88956568eb045e9a0/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.490780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52a1f1edf9d43cd94f91e6f2591d9d0, user_id=397fbb907cb240f88956568eb045e9a0, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.493450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.503733 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:41.506435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1321/2564] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:41 2022] PUT /identity/v3/projects/e52a1f1edf9d43cd94f91e6f2591d9d0/users/397fbb907cb240f88956568eb045e9a0/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:41.507166 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.559447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d790b44d60e4bddad6661ef4eba1ecb', 'request_id': 'req-98128037-9755-4837-921a-393c1dac11c6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.568181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d790b44d60e4bddad6661ef4eba1ecb', 'request_id': 'req-98128037-9755-4837-921a-393c1dac11c6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.571154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c43a2-a65f-4f26-bbf6-5dc2bd650e2f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.576785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.577508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.577813 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.578092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] PATH_INFO: `/v3/projects/027334234ddf4e5ca37d821ba4294fc9/users/b008b2bb292545d79c0f316214056f72/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.580530 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] The token cache is being invalidate because project 2d790b44d60e4bddad6661ef4eba1ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:41.580906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.581632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-98128037-9755-4837-921a-393c1dac11c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:41.583141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1244/2565] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:41 2022] DELETE /identity/v3/projects/2d790b44d60e4bddad6661ef4eba1ecb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:41.584332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.584614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.584922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.598208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=027334234ddf4e5ca37d821ba4294fc9, user_id=b008b2bb292545d79c0f316214056f72, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.603459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.617423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:41.619317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.630402 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1245/2566] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:41.632139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.633681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.648664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38d4f-ada0-4f8b-a3d1-84272280a084 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.654285 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.654897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.655305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.655588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.656251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:41.656556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.658283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d94e7-f9ca-4233-827f-315b4fa89b74 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.672586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1246/2567] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:41.673904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.674271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.674624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.698927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1322/2568] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:41 2022] PUT /identity/v3/projects/027334234ddf4e5ca37d821ba4294fc9/users/b008b2bb292545d79c0f316214056f72/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:41.700895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.709263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] MFA Rules not processed for user `397fbb907cb240f88956568eb045e9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:41.710673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.778300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ff4df-2d06-42d2-b341-d84329fd6cff admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.786083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.786902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.787053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.787272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.787949 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:41.788476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.790376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f710-151e-426a-a73f-a1b80b9d4394 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.793287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1247/2569] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:41.794553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.804699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1323/2570] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:41.804699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.804699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.804699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.812625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ae28-d09e-445c-9621-b9f4ef39e2e2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.819051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.819582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.819870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.820146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.820996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.824426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.832684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:41.834007 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.846142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1324/2571] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:41.853798 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.865328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c0577-fc4f-48c7-a36a-6e5d4716bb91 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.870906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.871536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.871823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.872098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.872744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.874844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.006848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1248/2572] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:42.007844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.009553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:42.051199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1325/2573] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:42.051199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.051199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:42.069417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92674-8ecf-406b-a571-a070643f2bb3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.111279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86eaf-eadb-473a-9690-5e976124102c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.114983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.115592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.116010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.116285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.117291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.117906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.118185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.118460 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.172571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:42.189684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.190508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.191169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.191965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.202018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1249/2575] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:42.202204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1326/2575] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:42.202693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.202857 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.215814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3fcf-ff38-4791-9132-75955797da39 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.216103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a859fe0-aad2-4e5c-a09c-3786cb3491a0 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.221679 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.221868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.222407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.222534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.222681 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.222822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.222954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.223109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.223750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.224015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.225728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.226320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.404484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1327/2576] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:42 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:42.405283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1250/2577] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:42 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:42.405750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.409370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.420758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebb853-a357-480c-8b22-7e302fdcaef8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.421699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108d0fb-8735-4ec6-a620-1849256cb42e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.426181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.426584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.426875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.427149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.427799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.429460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.433625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.434252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.434539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.434819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.435507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.437182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.440311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1328/2578] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:42.444515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.454746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1251/2579] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:42.454931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635006-229d-44a0-983e-d5c6c3b39c9a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.455970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.460048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.460671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.461051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.461320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.461968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.464227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.471104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4b1c-e083-4d51-af2c-f1ffb869ba23 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.476065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1329/2580] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:42.481625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.483457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.484495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.485109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.485570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.486668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.489103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.493211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7c7d0-223b-498e-ae73-10cc9f59ef2f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.504137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86a7c-d7a4-4f15-899f-4a2e5915395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.505687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86a7c-d7a4-4f15-899f-4a2e5915395d admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.506307 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86a7c-d7a4-4f15-899f-4a2e5915395d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.507328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86a7c-d7a4-4f15-899f-4a2e5915395d admin admin] PATH_INFO: `/v3/projects/e617bf9591ec41c6881c443d91414528/users/4a94df8154af4c8f937b97d8e683d21c/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.508114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1252/2581] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:42.512869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.523822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5571-f7b1-4458-ae0a-4006baccd27b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.529483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a26b-d144-41bf-89f1-dc2df3b45e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.530314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a26b-d144-41bf-89f1-dc2df3b45e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.530988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a26b-d144-41bf-89f1-dc2df3b45e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.530988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a26b-d144-41bf-89f1-dc2df3b45e96 admin admin] PATH_INFO: `/v3/projects/74378972543645febbab3924aeb4b855/users/5d63483b6ba4469ca7191329890bd9d1/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.533064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f86a7c-d7a4-4f15-899f-4a2e5915395d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e617bf9591ec41c6881c443d91414528, user_id=4a94df8154af4c8f937b97d8e683d21c, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.535975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f86a7c-d7a4-4f15-899f-4a2e5915395d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.554519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a26b-d144-41bf-89f1-dc2df3b45e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74378972543645febbab3924aeb4b855, user_id=5d63483b6ba4469ca7191329890bd9d1, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.557416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a26b-d144-41bf-89f1-dc2df3b45e96 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.729842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1330/2582] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:42 2022] PUT /identity/v3/projects/e617bf9591ec41c6881c443d91414528/users/4a94df8154af4c8f937b97d8e683d21c/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:42.731981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1253/2583] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:42 2022] PUT /identity/v3/projects/74378972543645febbab3924aeb4b855/users/5d63483b6ba4469ca7191329890bd9d1/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:42.732559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.732972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.733359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.743283 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.743861 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.745442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.767498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:42.768911 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:42.780372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] MFA Rules not processed for user `5d63483b6ba4469ca7191329890bd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:42.782338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:42.865876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1331/2584] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:42.887309 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.889442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:42.903034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1254/2585] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:42.907808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:42.921939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982edf-1792-40dd-bb08-aa0b5676c9bd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.931524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.931524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.931524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.931524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:42.932533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:42.932533 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:42.985737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9649b-babb-4f3b-802a-a26f34b346d9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:42.989534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:42.990159 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:42.990438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:42.990715 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.001895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.003586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.014832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1332/2586] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:43.082863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1255/2587] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:42 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:43.087567 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.097999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc7de8-5977-4e4d-9377-4036dc7daf99 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.160044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.160663 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.160941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.161219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.161868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.163852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.337415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1333/2588] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:43 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:43.342242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.354704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada40a-b463-4be6-bfaf-394cc34c5d32 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.358518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.359203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.359569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.359928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.360649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.362399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.373646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1256/2589] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:43.385565 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.395932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46866ae-cf4a-41e3-9beb-e1caa7b53b97 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.401259 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.401923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.402206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.403113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] PATH_INFO: `/v3/projects/6c8da61ebb084a7295e1248db23aee4e/users/c1f494a74e6c435188356c7bae3d4cf1/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.545331 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8da61ebb084a7295e1248db23aee4e, user_id=c1f494a74e6c435188356c7bae3d4cf1, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.548103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.703627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1334/2590] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:43 2022] PUT /identity/v3/projects/6c8da61ebb084a7295e1248db23aee4e/users/c1f494a74e6c435188356c7bae3d4cf1/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:43.708551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.721534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3e95-eddc-4aea-af21-79972890c3f4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.773282 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:43.776518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.792117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.796883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.796883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.796883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.796883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.796883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.809795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1257/2591] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:43.812020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.823770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6c73-1e80-4fe6-bb68-b70a9c5f97cd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.829247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e490-efe2-4d53-b749-7c4ce786508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.829979 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e490-efe2-4d53-b749-7c4ce786508d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.830260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e490-efe2-4d53-b749-7c4ce786508d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.830540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e490-efe2-4d53-b749-7c4ce786508d admin admin] PATH_INFO: `/v3/projects/6c8da61ebb084a7295e1248db23aee4e/users/c1f494a74e6c435188356c7bae3d4cf1/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.832632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e490-efe2-4d53-b749-7c4ce786508d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8da61ebb084a7295e1248db23aee4e, user_id=c1f494a74e6c435188356c7bae3d4cf1, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.835394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4e490-efe2-4d53-b749-7c4ce786508d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.847998 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1258/2592] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:43 2022] PUT /identity/v3/projects/6c8da61ebb084a7295e1248db23aee4e/users/c1f494a74e6c435188356c7bae3d4cf1/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:43.867883 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e184-65b4-4b27-966d-10ac35510759 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.884083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.884492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.884962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.926258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] MFA Rules not processed for user `c1f494a74e6c435188356c7bae3d4cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:43.927496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:43.934437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397fbb907cb240f88956568eb045e9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.963602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.963602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.963602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.963602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:43.963602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.964084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:43.964084 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1335/2593] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:43.966555 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:43.978119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe62e6-d02a-4f6e-ac11-6c362a044f83 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:43.986351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207ae7-a589-4a38-9240-e54e22009eb8 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397fbb907cb240f88956568eb045e9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:43.986970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207ae7-a589-4a38-9240-e54e22009eb8 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:43.987250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207ae7-a589-4a38-9240-e54e22009eb8 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:43.987530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207ae7-a589-4a38-9240-e54e22009eb8 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:43.988174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207ae7-a589-4a38-9240-e54e22009eb8 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:43.990089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207ae7-a589-4a38-9240-e54e22009eb8 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:44.010094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1259/2594] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:44.021935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:44.023612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:44.082191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6d4d-f0ad-455d-885d-ed4b6427c87b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:44.085932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:44.086538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:44.086816 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:44.087085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:44.098339 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:44.099766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:44.111592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1260/2595] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:44.438140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1336/2596] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:43 2022] POST /identity/v3/projects => generated 353 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:44.443051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:44.453970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:44.454712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:44.455176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:44.464111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1ca0-aa81-4349-9c5f-c8af8ac08901 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:44.494192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] MFA Rules not processed for user `b008b2bb292545d79c0f316214056f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:44.495554 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:44.546031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397fbb907cb240f88956568eb045e9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:44.550794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:44.552269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:44.552740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:44.553929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:44.554488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:44.556782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:44.573555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1261/2597] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:44.584352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1337/2598] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:44.591337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:44.594043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:44.643861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:44.657608 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a849bd-7224-4b42-90fb-8569c6ab1e80 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:44.663560 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397fbb907cb240f88956568eb045e9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:44.664250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:44.664842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:44.665155 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] PATH_INFO: `/v3/projects/c0e38571c35b439ca87015bc13b5ca47` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:44.666519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c0e38571c35b439ca87015bc13b5ca47)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:44.668758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:44.687982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4240d12-0379-4b55-bd6a-7cf4a4f6f409 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:44.702680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:44.703352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:44.703638 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:44.703917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:44.704575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:44.706591 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:44.840420 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1262/2599] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:44 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:44.841265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:44.855158 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e38571c35b439ca87015bc13b5ca47', 'request_id': 'req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:44.906214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7ce1-49ce-49be-ae47-e8ced8c1a16b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:44.910450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:44.911152 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:44.911521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:44.911900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:44.996734 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:44.998509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:45.008699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1263/2600] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:45.009689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:45.011243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e38571c35b439ca87015bc13b5ca47', 'request_id': 'req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:45.020101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e38571c35b439ca87015bc13b5ca47', 'request_id': 'req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:45.039626 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] The token cache is being invalidate because project c0e38571c35b439ca87015bc13b5ca47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:45.040221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:45.041952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:45.044055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1338/2601] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:44 2022] DELETE /identity/v3/projects/c0e38571c35b439ca87015bc13b5ca47 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:45.092286 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3290c-1f6c-4176-a6a1-0bf00e6463a3 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:45.101476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:45.102234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:45.102589 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:45.103077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:45.104329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:45.106372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:45.215204 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1264/2602] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:45 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:45.217066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:45.219123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:45.292834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b31c8f-d6f0-4a6e-9829-b83adc2ca886 tempest-VolumeQuotaClassesTest-644223292 tempest-VolumeQuotaClassesTest-644223292-project-admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:45.297495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:45.298109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:45.298385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:45.298696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:45.299325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:45.300971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:45.320349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1339/2603] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:45.324747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:45.339514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ddcc-9376-4e85-8da8-e9d15aa5b8a8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:45.345945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:45.346866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:45.347188 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:45.347505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] PATH_INFO: `/v3/projects/734687c6c7624646a198a68b020e0818/users/7b4ee1596f684a33a900d327e7d3d6c5/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:45.367385 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734687c6c7624646a198a68b020e0818, user_id=7b4ee1596f684a33a900d327e7d3d6c5, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:45.373057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:45.391125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:45.584313 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1265/2604] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:45 2022] PUT /identity/v3/projects/734687c6c7624646a198a68b020e0818/users/7b4ee1596f684a33a900d327e7d3d6c5/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:45.586571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:45.603055 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b39f4-2bf1-4405-a641-d11380511ca7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:45.679421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:45.680135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:45.680421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:45.680752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:45.681463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:45.684281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:45.697520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1340/2605] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:45.705963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:45.720797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4be1ad-7603-4811-b0c5-d9e32728e3e9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:45.727195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a8e80-5143-441d-b046-cf95ca83ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:45.727880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a8e80-5143-441d-b046-cf95ca83ba07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:45.728162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a8e80-5143-441d-b046-cf95ca83ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:45.729172 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a8e80-5143-441d-b046-cf95ca83ba07 admin admin] PATH_INFO: `/v3/projects/734687c6c7624646a198a68b020e0818/users/7b4ee1596f684a33a900d327e7d3d6c5/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:45.731975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a8e80-5143-441d-b046-cf95ca83ba07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734687c6c7624646a198a68b020e0818, user_id=7b4ee1596f684a33a900d327e7d3d6c5, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:45.734789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a8e80-5143-441d-b046-cf95ca83ba07 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:45.754151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1266/2606] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:45 2022] PUT /identity/v3/projects/734687c6c7624646a198a68b020e0818/users/7b4ee1596f684a33a900d327e7d3d6c5/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:46.063105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:46.069490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:46.126753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113fed7-2ecd-4327-bd0e-b8ed876d2714 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:46.210231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:46.211170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:46.211598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:46.211887 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] PATH_INFO: `/v3/users/68d475bf67594f38ba5ec861aab53452` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:46.213546 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d475bf67594f38ba5ec861aab53452)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:46.215406 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:46.559780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d475bf67594f38ba5ec861aab53452'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:46.585874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d475bf67594f38ba5ec861aab53452'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:46.594805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d475bf67594f38ba5ec861aab53452'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:46.596275 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d475bf67594f38ba5ec861aab53452'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:46.766636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d475bf67594f38ba5ec861aab53452'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:46.814599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1341/2607] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:46 2022] DELETE /identity/v3/users/68d475bf67594f38ba5ec861aab53452 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:46.821806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4c37-2967-43ef-a461-1efca49a1dba None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:46.822396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4c37-2967-43ef-a461-1efca49a1dba None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:46.823914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4c37-2967-43ef-a461-1efca49a1dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:46.919377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0e6a4c37-2967-43ef-a461-1efca49a1dba None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:46.921454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0e6a4c37-2967-43ef-a461-1efca49a1dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:47.104416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1267/2608] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:47.143132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:47.145399 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:47.211827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:47.266386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80060eac-5217-4e78-9f7e-fd88af3ea1c7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:47.273134 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72fb7-faf5-4534-8f09-3ac1cf71a108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:47.277196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72fb7-faf5-4534-8f09-3ac1cf71a108 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:47.277491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72fb7-faf5-4534-8f09-3ac1cf71a108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:47.277770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72fb7-faf5-4534-8f09-3ac1cf71a108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:47.297047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72fb7-faf5-4534-8f09-3ac1cf71a108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:47.299203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72fb7-faf5-4534-8f09-3ac1cf71a108 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:47.312844 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1342/2609] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:47.596772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:47.811322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:47.811822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:47.812319 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:47.901074 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] MFA Rules not processed for user `7b4ee1596f684a33a900d327e7d3d6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:47.902024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:48.129558 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1268/2610] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:48.141993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:48.142927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:48.143457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:48.171898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] MFA Rules not processed for user `b008b2bb292545d79c0f316214056f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:48.173566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:48.208982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:48.210596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:48.236141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82788c8-62b1-468a-a2dc-0f90af0c964b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:48.248111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:48.249171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:48.249171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:48.249799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] PATH_INFO: `/v3/projects/a932a4420041423cb195a24ff6e86bc0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:48.251473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a932a4420041423cb195a24ff6e86bc0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:48.255249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:48.297926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1343/2611] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:48.320148 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:48.325526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:48.456003 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a932a4420041423cb195a24ff6e86bc0', 'request_id': 'req-885995b0-f263-4c47-9db2-66d84dfd3d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:48.501011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043706f-86de-44bd-8420-1776604a87b4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:48.573702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a932a4420041423cb195a24ff6e86bc0', 'request_id': 'req-885995b0-f263-4c47-9db2-66d84dfd3d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:48.589113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a932a4420041423cb195a24ff6e86bc0', 'request_id': 'req-885995b0-f263-4c47-9db2-66d84dfd3d40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:48.603202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] The token cache is being invalidate because project a932a4420041423cb195a24ff6e86bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:48.603779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:48.604400 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:48.611887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1269/2612] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:48 2022] DELETE /identity/v3/projects/a932a4420041423cb195a24ff6e86bc0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:48.613375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:48.621248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:48.636923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:48.638559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:48.639308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:48.640001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:48.644577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:48.749144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:48.751385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:48.763532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1344/2613] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:48.774060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885995b0-f263-4c47-9db2-66d84dfd3d40 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:48.787511 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:48.789015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:48.789514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:48.790049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] PATH_INFO: `/v3/users/397fbb907cb240f88956568eb045e9a0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:48.793229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] RBAC: Authorizing `identity:delete_user(user_id=397fbb907cb240f88956568eb045e9a0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:48.797011 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:49.237804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397fbb907cb240f88956568eb045e9a0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:49.238437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397fbb907cb240f88956568eb045e9a0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:49.284127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397fbb907cb240f88956568eb045e9a0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:49.297549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397fbb907cb240f88956568eb045e9a0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:49.298899 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-46912df6-592c-4e5f-8aac-2a70aa8e300a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397fbb907cb240f88956568eb045e9a0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:49.488163 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1270/2614] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:48 2022] DELETE /identity/v3/users/397fbb907cb240f88956568eb045e9a0 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:50.473807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:50.496660 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bae3e-b27a-4007-9183-6bd3440d49f6 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:50.642141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:50.643385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:50.643929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:50.644457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] PATH_INFO: `/v3/projects/e52a1f1edf9d43cd94f91e6f2591d9d0` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:50.649965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52a1f1edf9d43cd94f91e6f2591d9d0)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:50.654548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:50.824027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:50.833214 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'request_id': 'req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:51.012610 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'request_id': 'req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:51.024305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52a1f1edf9d43cd94f91e6f2591d9d0', 'request_id': 'req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:51.048638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] The token cache is being invalidate because project e52a1f1edf9d43cd94f91e6f2591d9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:51.049017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:51.049893 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e00efd2-f3fd-471c-abe9-3f5d88e0e6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:51.051801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1345/2615] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:50 2022] DELETE /identity/v3/projects/e52a1f1edf9d43cd94f91e6f2591d9d0 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:51.057508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.058048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.058048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.087307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:51.089461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:51.191957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1271/2616] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:51.202283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308628-2226-4a33-906c-199b58cd5747 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.202656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308628-2226-4a33-906c-199b58cd5747 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.203385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308628-2226-4a33-906c-199b58cd5747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.243992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-75308628-2226-4a33-906c-199b58cd5747 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:51.245819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-75308628-2226-4a33-906c-199b58cd5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:51.261868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1346/2617] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:51.268658 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:51.291233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cf49e-2120-4ef6-89a1-f4c583feff4c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:51.298138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:51.303834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:51.305034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.305515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.305948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.307013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:51.308085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:51.311486 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:51.336783 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1272/2618] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:51.342251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308628-2226-4a33-906c-199b58cd5747 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:51.368636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308628-2226-4a33-906c-199b58cd5747 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:51.384891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:51.384891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.384891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.384891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.385918 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:51.387901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:51.550039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1347/2619] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:51 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:51.554143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:51.574469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57e4a-08ec-4a56-b68a-2ab030cbcf6f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:51.693674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:51.695708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.697088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.697333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.698084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:51.702054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:51.830567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1273/2620] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:51 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:51.834718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:51.854433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557f86-88e9-47ce-8d00-1f76457260f1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:51.873810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:51.874630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.874989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.875484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.876671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:51.882087 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:51.905011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1348/2621] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:51.909698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:51.940676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6840-6cda-488a-817e-f43993151bd0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:51.951913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf74a1-4b56-414a-a05b-31f59b6c7401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:51.955386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf74a1-4b56-414a-a05b-31f59b6c7401 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.955933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf74a1-4b56-414a-a05b-31f59b6c7401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.957395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf74a1-4b56-414a-a05b-31f59b6c7401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.957728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf74a1-4b56-414a-a05b-31f59b6c7401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:51.960689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf74a1-4b56-414a-a05b-31f59b6c7401 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:51.998092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1274/2622] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:52.001885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:52.024426 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb828-16ab-460d-bd5a-3a018f3325e9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:52.033536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:52.034488 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.034938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.035519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] PATH_INFO: `/v3/projects/92d0726c08c444c1b1c11ef6b000dc9a/users/8c58bbba2ec34db694b50e06e49e4b72/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.061607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d0726c08c444c1b1c11ef6b000dc9a, user_id=8c58bbba2ec34db694b50e06e49e4b72, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:52.064898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:52.205071 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1349/2623] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:51 2022] PUT /identity/v3/projects/92d0726c08c444c1b1c11ef6b000dc9a/users/8c58bbba2ec34db694b50e06e49e4b72/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:52.217196 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc29c3-f1c6-462e-8558-fc8baa4dd352 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.217814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc29c3-f1c6-462e-8558-fc8baa4dd352 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.219814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc29c3-f1c6-462e-8558-fc8baa4dd352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.257416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-65bc29c3-f1c6-462e-8558-fc8baa4dd352 None None] MFA Rules not processed for user `8c58bbba2ec34db694b50e06e49e4b72`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:52.260935 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-65bc29c3-f1c6-462e-8558-fc8baa4dd352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:52.380522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1275/2624] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:52.387970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:52.548161 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f1ae9-0b18-4722-8935-b9388cb2fa0f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:52.574123 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:52.578486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.578900 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.585264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.585264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:52.586097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:52.664479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.665053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.665583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.707355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] MFA Rules not processed for user `4a94df8154af4c8f937b97d8e683d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:52.710505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:52.734421 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1350/2625] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:52 2022] POST /identity/v3/projects => generated 381 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:52.735876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:52.810885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1276/2626] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:52.813449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37420f-0f02-43f5-b0b1-f72ede71656b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:52.815517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:52.816980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:52.818507 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:52.819171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.819457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.819770 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.820414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:52.823211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:52.833244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec460f7-12ac-4b21-bd9a-b91b139f35ec None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:52.838721 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:52.839370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.839643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.839916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.840561 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:52.842562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:52.946213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1351/2627] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:52 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:52.952739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:52.970015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99a74-e982-4964-918f-12a155c3267e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:52.977266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:52.978302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:52.978875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:52.979324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:52.980672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:52.983723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:52.999964 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1352/2628] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:53.003202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1277/2629] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:52 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:39:53.004264 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.008019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.025263 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d61d5-83c4-4088-bc2a-1fa073fecd4f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.106242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.106927 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.107308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.107462 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] PATH_INFO: `/v3/projects/8a36019254b441189ae009f298d313de/users/50855aece802414d84ca3c8c1def3c1f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.120752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc39a-3004-4c1c-8cd0-bb4439e8b1ef admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.128536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.129543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.130052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.130524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.131624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.132364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a36019254b441189ae009f298d313de, user_id=50855aece802414d84ca3c8c1def3c1f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.136098 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.136249 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.258614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1353/2630] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:53 2022] PUT /identity/v3/projects/8a36019254b441189ae009f298d313de/users/50855aece802414d84ca3c8c1def3c1f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:53.263720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.337822 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3e925-77ec-4e0d-b71d-490bd93ba142 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.343498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.344122 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.344445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.344681 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.345590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.347189 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.348606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1278/2631] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:53 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:53.352512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.361273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1354/2632] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:53.365405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.367349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc4d47-e29c-4be4-90b8-e2ecba165757 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.373408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.374022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.374476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.374802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.375560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.376322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b0aa8-7437-49c6-84e3-ef913dc04957 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.377229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.381425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da341327-5cc5-4e84-8d0e-49151ca07116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.382165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341327-5cc5-4e84-8d0e-49151ca07116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.382456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341327-5cc5-4e84-8d0e-49151ca07116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.382726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341327-5cc5-4e84-8d0e-49151ca07116 admin admin] PATH_INFO: `/v3/projects/8a36019254b441189ae009f298d313de/users/50855aece802414d84ca3c8c1def3c1f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.385092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341327-5cc5-4e84-8d0e-49151ca07116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a36019254b441189ae009f298d313de, user_id=50855aece802414d84ca3c8c1def3c1f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.388004 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341327-5cc5-4e84-8d0e-49151ca07116 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.400418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1279/2633] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:53.400613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1355/2634] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:53 2022] PUT /identity/v3/projects/8a36019254b441189ae009f298d313de/users/50855aece802414d84ca3c8c1def3c1f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:53.410242 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.416680 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e270f-46be-4398-a934-8ce833095a79 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.417192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e270f-46be-4398-a934-8ce833095a79 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.417380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e270f-46be-4398-a934-8ce833095a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.423250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a298bf-ccf6-428b-a062-73af9ec8b955 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.449669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-927e270f-46be-4398-a934-8ce833095a79 None None] MFA Rules not processed for user `50855aece802414d84ca3c8c1def3c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:53.451020 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-927e270f-46be-4398-a934-8ce833095a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:53.496205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.497057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.497343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.497623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] PATH_INFO: `/v3/projects/edfd7bcebfda4dc4a9ec07402254624e/users/0125265ed89349ff88bdd826c575c6bb/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.514729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd7bcebfda4dc4a9ec07402254624e, user_id=0125265ed89349ff88bdd826c575c6bb, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.517576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.532016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1356/2635] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:39:53.545090 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e270f-46be-4398-a934-8ce833095a79 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.547612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-927e270f-46be-4398-a934-8ce833095a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:53.606498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1280/2636] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:53 2022] PUT /identity/v3/projects/edfd7bcebfda4dc4a9ec07402254624e/users/0125265ed89349ff88bdd826c575c6bb/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:53.607823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.622059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e270f-46be-4398-a934-8ce833095a79 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.684382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.685116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.685614 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.686035 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.717201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3b76-0dda-4259-89ff-799f1140ebe8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.730781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.731451 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.732432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.732432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.732966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.734781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.747930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1281/2637] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:39:53.756870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.793867 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5f1c-53a4-4820-aef2-fb5466c23316 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.796130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.800156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.804186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.804186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.804186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] PATH_INFO: `/v3/projects/edfd7bcebfda4dc4a9ec07402254624e/users/0125265ed89349ff88bdd826c575c6bb/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.804186 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd7bcebfda4dc4a9ec07402254624e, user_id=0125265ed89349ff88bdd826c575c6bb, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.807067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.811381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.820862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1282/2638] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:53 2022] PUT /identity/v3/projects/edfd7bcebfda4dc4a9ec07402254624e/users/0125265ed89349ff88bdd826c575c6bb/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:53.826250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1357/2639] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:53.903409 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:53.940464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:54.020728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ab0f-dd99-42c9-b726-23dbccc111fd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:54.029143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:54.030415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:54.031043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:54.031639 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:54.126679 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:54.128240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:54.139691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1283/2640] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:54.890695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:55.223984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:56.744932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:56.746652 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:56.898977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cf6bb-ef57-4536-8395-f8cfec08c3cb service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:57.004082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:57.004958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:57.005298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:57.005726 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:57.008104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:57.026177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:57.044313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec2d6-e18c-41cf-b0e3-62e29162c454 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:57.081921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1358/2641] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:57.734278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:58.056542 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:58.139399 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa8c0-504d-4633-8c86-ff7817081733 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:58.145130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:58.145800 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:58.146086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:58.146369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] PATH_INFO: `/v3/users/8c58bbba2ec34db694b50e06e49e4b72` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:58.147581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c58bbba2ec34db694b50e06e49e4b72)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:58.149729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:58.460671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c58bbba2ec34db694b50e06e49e4b72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:58.463441 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c58bbba2ec34db694b50e06e49e4b72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:58.479831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c58bbba2ec34db694b50e06e49e4b72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:58.490158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c58bbba2ec34db694b50e06e49e4b72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:58.495376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c58bbba2ec34db694b50e06e49e4b72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:58.793418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1284/2642] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:58 2022] DELETE /identity/v3/users/8c58bbba2ec34db694b50e06e49e4b72 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:58.794241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:58.794826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:58.794961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:58.826656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:58.827938 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:58.955492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1359/2643] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:59.044938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:59.047814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:59.193437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedfff8-89cc-4f7e-80d4-e971c10f67f7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:59.198272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:59.199406 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:59.199799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:59.200177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:59.211981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:59.214312 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:59.229448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1285/2644] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:00.085339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:00.087543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:00.111344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:00.116709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bce7-87d6-44fb-bea4-17fd38e5fa93 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:00.124656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:00.125251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:00.126251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:00.126658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] PATH_INFO: `/v3/projects/92d0726c08c444c1b1c11ef6b000dc9a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:00.129762 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d0726c08c444c1b1c11ef6b000dc9a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:00.132157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:00.356238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d0726c08c444c1b1c11ef6b000dc9a', 'request_id': 'req-c87483f4-1017-4af6-b5a8-c458b620b484'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:00.559649 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d0726c08c444c1b1c11ef6b000dc9a', 'request_id': 'req-c87483f4-1017-4af6-b5a8-c458b620b484'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:00.571725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d0726c08c444c1b1c11ef6b000dc9a', 'request_id': 'req-c87483f4-1017-4af6-b5a8-c458b620b484'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:00.598033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] The token cache is being invalidate because project 92d0726c08c444c1b1c11ef6b000dc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:00.598386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:00.599235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c87483f4-1017-4af6-b5a8-c458b620b484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:00.601332 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1360/2645] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:00 2022] DELETE /identity/v3/projects/92d0726c08c444c1b1c11ef6b000dc9a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:00.609752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:00.639728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec863ac-056e-4615-8e22-85c1faddd78a service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:00.749501 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:00.750224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:00.750744 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:00.751014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] PATH_INFO: `/v3/users/50855aece802414d84ca3c8c1def3c1f` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:00.752581 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50855aece802414d84ca3c8c1def3c1f)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:00.755141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:01.592506 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50855aece802414d84ca3c8c1def3c1f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:01.593201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50855aece802414d84ca3c8c1def3c1f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:01.613838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50855aece802414d84ca3c8c1def3c1f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:01.618233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50855aece802414d84ca3c8c1def3c1f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:01.619369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50855aece802414d84ca3c8c1def3c1f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:01.914869 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1286/2646] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:00 2022] DELETE /identity/v3/users/50855aece802414d84ca3c8c1def3c1f => generated 0 bytes in 1306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:02.067072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:02.077882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:02.077882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:02.127542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] MFA Rules not processed for user `0125265ed89349ff88bdd826c575c6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:02.139407 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:02.203669 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1361/2647] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:02.217472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:02.218965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:02.298940 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72281ee-b082-41c5-820a-8e9b4cf753e4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:02.305062 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:02.305626 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:02.305907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:02.306969 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:02.309617 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:02.373887 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:02.375494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b771b-80b6-4856-8c2f-7f4e710fbde8 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:02.387529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1287/2648] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:03.056587 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:03.078653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:03.078653 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:03.159030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413dd5-3b2b-471a-b6e9-b9ccf36baaa3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:03.163895 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:03.164593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:03.164891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:03.165176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] PATH_INFO: `/v3/projects/8a36019254b441189ae009f298d313de` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:03.166881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a36019254b441189ae009f298d313de)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:03.169073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:03.361285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a36019254b441189ae009f298d313de', 'request_id': 'req-878a617a-b956-46dd-ae84-934097f2f1b2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:03.537149 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a36019254b441189ae009f298d313de', 'request_id': 'req-878a617a-b956-46dd-ae84-934097f2f1b2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:03.553460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a36019254b441189ae009f298d313de', 'request_id': 'req-878a617a-b956-46dd-ae84-934097f2f1b2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:03.576129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] The token cache is being invalidate because project 8a36019254b441189ae009f298d313de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:03.576129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:03.576129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-878a617a-b956-46dd-ae84-934097f2f1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:03.576129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1362/2649] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:03 2022] DELETE /identity/v3/projects/8a36019254b441189ae009f298d313de => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:03.579747 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:03.580228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:03.580328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:03.605729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:03.606997 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:03.669782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1288/2650] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:03.677708 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:03.678231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:03.678737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:03.700176 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:03.701710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:03.711015 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1363/2651] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:03.716004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:03.729229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63581b00-c85f-4c15-9ab3-d7d82c8d3bc7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:03.752219 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:03.753026 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:03.753411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:03.753796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:03.754601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:40:03.755151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:03.757924 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:03.782566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1289/2652] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:40:03.783528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:03.798184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024bab-b179-4660-8f5d-befe2781ce9f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:03.803643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:03.804344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:03.804627 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:03.804939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:03.805583 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:03.807526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:04.027056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1364/2653] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:03 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:40:04.028233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:04.039016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b73ba-ce77-4a83-9693-4b97fec5d6a8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:04.102795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:04.103416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:04.103700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:04.104067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:04.104714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:04.108068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:04.365314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1290/2654] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:04 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:04.366953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:04.379611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a093c4-af94-4d03-8e45-bc4563cbe399 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:04.384519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:04.386412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:04.386412 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:04.386722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:04.387204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:04.389026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:04.402423 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1365/2655] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:40:04.404096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:04.414753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026b1dd-d91f-4b2d-a0ab-69c667de3a2f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:04.422519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d71be-5f56-4aca-8fc2-8bbf1ee72a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:04.422519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d71be-5f56-4aca-8fc2-8bbf1ee72a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:04.422519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d71be-5f56-4aca-8fc2-8bbf1ee72a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:04.422519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d71be-5f56-4aca-8fc2-8bbf1ee72a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:04.423141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d71be-5f56-4aca-8fc2-8bbf1ee72a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:04.425085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d71be-5f56-4aca-8fc2-8bbf1ee72a79 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:04.441553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1291/2656] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:04.448875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:04.487570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234e16-f364-4dae-aca3-284516b5e2e6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:04.496170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:04.496992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:04.497348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:04.497701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] PATH_INFO: `/v3/projects/6944a5ae4ceb4da39facbfe3b4f59dad/users/d75b47ec654f4c99aceb541653c3c958/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:04.518478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6944a5ae4ceb4da39facbfe3b4f59dad, user_id=d75b47ec654f4c99aceb541653c3c958, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:04.522543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:04.821530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1366/2657] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:04 2022] PUT /identity/v3/projects/6944a5ae4ceb4da39facbfe3b4f59dad/users/d75b47ec654f4c99aceb541653c3c958/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:40:04.830154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:04.830631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:04.830963 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:04.880711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] MFA Rules not processed for user `d75b47ec654f4c99aceb541653c3c958`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:04.889080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:04.959663 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1292/2658] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:04.961592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.033661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380b29a-c67e-478b-b283-44a8b3ebe8bb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:05.040343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:05.040343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.040343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.040343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.047769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:05.047769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:05.195470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1367/2659] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:04 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:05.197012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.211430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf302-3a34-4222-bf1b-18fb3715fe99 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:05.285870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:05.286600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.286942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.289008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.289008 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:05.290131 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:05.386508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1293/2660] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:05 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:05.388065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.399609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a2ed-1238-49dc-bec0-c6ad59d08aa9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:05.404700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:05.405451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.406735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.406735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.406735 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:05.408514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:05.422198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1368/2661] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:05.426868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.438309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93b23b-f9f5-4556-acd4-77171aa3112b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:05.443117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:05.443801 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.444088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.444368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] PATH_INFO: `/v3/projects/8111cbdb67144d47b3dd81826b8c71b5/users/530aad2e089f488d94e7d7578de92c7f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.462662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8111cbdb67144d47b3dd81826b8c71b5, user_id=530aad2e089f488d94e7d7578de92c7f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:05.465380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:05.599407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1294/2662] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:05 2022] PUT /identity/v3/projects/8111cbdb67144d47b3dd81826b8c71b5/users/530aad2e089f488d94e7d7578de92c7f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:05.603590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.615192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c829e7d-d351-4ba7-b9b3-36572a5cb0f5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:05.716463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791766-f3a7-4e55-9a3c-9864104a2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:05.717191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791766-f3a7-4e55-9a3c-9864104a2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.718109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791766-f3a7-4e55-9a3c-9864104a2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.718393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791766-f3a7-4e55-9a3c-9864104a2bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.719069 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791766-f3a7-4e55-9a3c-9864104a2bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:05.720709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791766-f3a7-4e55-9a3c-9864104a2bd4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:05.732361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1369/2663] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:05.736849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.748305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759528-cc67-4f20-bff6-dd0228ac37f0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:05.754105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:05.754890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.755240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.755609 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] PATH_INFO: `/v3/projects/8111cbdb67144d47b3dd81826b8c71b5/users/530aad2e089f488d94e7d7578de92c7f/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.757819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8111cbdb67144d47b3dd81826b8c71b5, user_id=530aad2e089f488d94e7d7578de92c7f, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:05.760759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:05.774447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1295/2664] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:05 2022] PUT /identity/v3/projects/8111cbdb67144d47b3dd81826b8c71b5/users/530aad2e089f488d94e7d7578de92c7f/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:05.793666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:05.793965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:05.794405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:05.837048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] MFA Rules not processed for user `530aad2e089f488d94e7d7578de92c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:05.837048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:05.918235 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1370/2665] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:40:05.929337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:05.931765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:06.018491 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c895f-0473-47b1-baba-6e001ec4f191 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:06.022426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e630f3-924a-4543-a9f1-d78e20ad037c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:06.023031 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e630f3-924a-4543-a9f1-d78e20ad037c service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:06.023311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e630f3-924a-4543-a9f1-d78e20ad037c service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:06.023586 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e630f3-924a-4543-a9f1-d78e20ad037c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:06.034123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e630f3-924a-4543-a9f1-d78e20ad037c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:06.036961 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e630f3-924a-4543-a9f1-d78e20ad037c service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:06.045117 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1296/2666] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:40:06.791986 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:06.888639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d681e-b2bc-4aea-b1d0-b438a68b4f65 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:06.898288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:06.898984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:06.899294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:06.899577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] PATH_INFO: `/v3/users/d75b47ec654f4c99aceb541653c3c958` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:06.902382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75b47ec654f4c99aceb541653c3c958)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:06.905281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:07.155018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045e45c-8f95-457e-ab27-8143f4e84b4d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:07.156078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045e45c-8f95-457e-ab27-8143f4e84b4d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:07.156759 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045e45c-8f95-457e-ab27-8143f4e84b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:07.184497 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1045e45c-8f95-457e-ab27-8143f4e84b4d None None] MFA Rules not processed for user `4a94df8154af4c8f937b97d8e683d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:07.185836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1045e45c-8f95-457e-ab27-8143f4e84b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:07.245696 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75b47ec654f4c99aceb541653c3c958'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:07.248865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1297/2667] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:40:07.273097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75b47ec654f4c99aceb541653c3c958'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:07.290013 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75b47ec654f4c99aceb541653c3c958'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:07.290791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75b47ec654f4c99aceb541653c3c958'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:07.354030 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:07.404469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75b47ec654f4c99aceb541653c3c958'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:07.412533 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1371/2668] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:06 2022] DELETE /identity/v3/users/d75b47ec654f4c99aceb541653c3c958 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:07.416948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:07.417246 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:07.417529 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:07.455022 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:07.456253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:07.536042 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1298/2669] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:07.549632 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:07.551193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:07.615289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc15e48-4743-455a-8142-ec4f381a9427 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:07.618931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:07.619566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:07.619850 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:07.620126 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:07.629280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:07.630709 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:07.641342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1372/2670] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:08.224277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:08.226066 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:08.238488 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5a5f-6d6e-44d0-a562-724ac810cca9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:08.250298 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:08.251504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:08.251902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:08.252191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] PATH_INFO: `/v3/projects/6944a5ae4ceb4da39facbfe3b4f59dad` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:08.253472 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6944a5ae4ceb4da39facbfe3b4f59dad)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:08.255715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:08.407712 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6944a5ae4ceb4da39facbfe3b4f59dad', 'request_id': 'req-6e7eebbb-5eb9-4d41-a463-a35699c41421'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:08.536207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6944a5ae4ceb4da39facbfe3b4f59dad', 'request_id': 'req-6e7eebbb-5eb9-4d41-a463-a35699c41421'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:08.549268 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6944a5ae4ceb4da39facbfe3b4f59dad', 'request_id': 'req-6e7eebbb-5eb9-4d41-a463-a35699c41421'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:08.564458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] The token cache is being invalidate because project 6944a5ae4ceb4da39facbfe3b4f59dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:08.564966 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:08.566178 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:08.569423 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1299/2671] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:08 2022] DELETE /identity/v3/projects/6944a5ae4ceb4da39facbfe3b4f59dad => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:08.580637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:08.591658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833a620-4328-4118-8682-1b3482f4629e service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:08.661078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:08.661723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:08.662011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:08.662296 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] PATH_INFO: `/v3/users/530aad2e089f488d94e7d7578de92c7f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:08.663522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] RBAC: Authorizing `identity:delete_user(user_id=530aad2e089f488d94e7d7578de92c7f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:08.665570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:09.077318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530aad2e089f488d94e7d7578de92c7f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:09.090774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530aad2e089f488d94e7d7578de92c7f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:09.098856 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530aad2e089f488d94e7d7578de92c7f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:09.099700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530aad2e089f488d94e7d7578de92c7f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:09.302536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:09.307760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e52694bc-7004-4144-ac71-2b1f352e811c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530aad2e089f488d94e7d7578de92c7f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:09.315648 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1373/2672] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:08 2022] DELETE /identity/v3/users/530aad2e089f488d94e7d7578de92c7f => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:40:09.949926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:09.955852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:09.965455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eebbb-5eb9-4d41-a463-a35699c41421 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:10.038099 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:10.038799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.039081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.039352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] PATH_INFO: `/v3/projects/8111cbdb67144d47b3dd81826b8c71b5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.040565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8111cbdb67144d47b3dd81826b8c71b5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:10.042590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:10.260139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8111cbdb67144d47b3dd81826b8c71b5', 'request_id': 'req-7dab0b4f-d983-4ee0-a287-869ded1995e4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:10.398835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8111cbdb67144d47b3dd81826b8c71b5', 'request_id': 'req-7dab0b4f-d983-4ee0-a287-869ded1995e4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:10.406411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8111cbdb67144d47b3dd81826b8c71b5', 'request_id': 'req-7dab0b4f-d983-4ee0-a287-869ded1995e4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:10.417559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] The token cache is being invalidate because project 8111cbdb67144d47b3dd81826b8c71b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:10.417854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:10.418528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7dab0b4f-d983-4ee0-a287-869ded1995e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:10.420024 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1300/2673] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:09 2022] DELETE /identity/v3/projects/8111cbdb67144d47b3dd81826b8c71b5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:10.431651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.432419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.432854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.461716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:10.462019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:10.544841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1374/2674] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:10.556583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.562903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.563377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.590643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:10.591922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:10.600881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1301/2675] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:10.606413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:10.626491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a7c3-b268-475c-b532-e46a7e6e7304 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:10.626491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:10.626491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.626491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.626842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.626842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:40:10.627097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:10.629062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:10.648776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1375/2676] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:40:10.650439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:10.661215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5f1b6-e59f-4981-9e67-c4bd43e77aee None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:10.667364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:10.677136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.677521 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.677804 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.678554 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:10.681915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:10.892845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1302/2677] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:10 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:10.897342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:10.908644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621109-d55c-4104-b935-4ea2d8f05a18 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:10.978116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:10.978763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.979044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.979700 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.980089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:10.981941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:11.143668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1376/2678] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:10 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:40:11.147882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:11.159614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2de51-7f0b-4885-a840-236af2189afd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:11.164327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:11.164973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:11.165260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:11.165569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:11.166254 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:11.167933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:11.179413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1303/2679] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:40:11.185832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:11.200255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737625f-6eab-4c7d-b99d-684a505d5cb9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:11.205643 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b68b8-281c-4094-83d9-224fce693e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:11.206265 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b68b8-281c-4094-83d9-224fce693e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:11.206543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b68b8-281c-4094-83d9-224fce693e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:11.206815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b68b8-281c-4094-83d9-224fce693e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:11.207487 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b68b8-281c-4094-83d9-224fce693e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:11.209212 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b68b8-281c-4094-83d9-224fce693e8b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:11.220988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1377/2680] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:11.225427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:11.236153 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65746-0d4c-47eb-8f1b-276e0d5f6767 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:11.241015 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:11.241682 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:11.241965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:11.242235 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] PATH_INFO: `/v3/projects/9687695439dd4c859110192aecdec529/users/3feff2958d10403ba7d842717839643c/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:11.258450 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9687695439dd4c859110192aecdec529, user_id=3feff2958d10403ba7d842717839643c, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:11.262018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:11.417250 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1304/2681] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:11 2022] PUT /identity/v3/projects/9687695439dd4c859110192aecdec529/users/3feff2958d10403ba7d842717839643c/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:11.485898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:11.486556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:11.486556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:11.516702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] MFA Rules not processed for user `3feff2958d10403ba7d842717839643c`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:11.517984 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:11.592416 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1378/2682] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:11.597279 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:11.669877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958240a8-d53c-41be-af79-9baada182820 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:11.679588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:11.679588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:11.679588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:11.679588 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:11.680613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:11.680613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:11.919013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1305/2683] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:11 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:11.920298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:11.939298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8871e-be33-47c9-8309-4d2ed5bd88f2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:12.005154 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:12.006001 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.006328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.006633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.007333 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:12.009495 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:12.151537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1379/2684] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:11 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:12.160223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:12.173297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158d30-2388-4ac6-87ee-a7be5256ec98 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:12.178237 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:12.178850 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.179134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.179513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.180231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:12.181989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:12.195227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1306/2685] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:12.199537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:12.210294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10472e-3fef-43b0-bb1e-ac0fc2e06a1d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:12.215277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feae724-95c6-4ad8-8c6e-4abefac1205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:12.215924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feae724-95c6-4ad8-8c6e-4abefac1205d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.216206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feae724-95c6-4ad8-8c6e-4abefac1205d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.216482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feae724-95c6-4ad8-8c6e-4abefac1205d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.217177 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feae724-95c6-4ad8-8c6e-4abefac1205d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:12.218780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feae724-95c6-4ad8-8c6e-4abefac1205d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:12.229955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1380/2686] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:12.234168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:12.245980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d10240-4117-41e3-b59f-b037c501e875 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:12.250928 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:12.251602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.252084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.252360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] PATH_INFO: `/v3/projects/88331e30c864440790eb6ebd671d9414/users/21b1701287d24977a7e456abe2c472d4/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.268504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88331e30c864440790eb6ebd671d9414, user_id=21b1701287d24977a7e456abe2c472d4, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:12.271531 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:12.407504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1307/2687] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:12 2022] PUT /identity/v3/projects/88331e30c864440790eb6ebd671d9414/users/21b1701287d24977a7e456abe2c472d4/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:12.419144 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.419704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.420016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.451313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] MFA Rules not processed for user `21b1701287d24977a7e456abe2c472d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:12.452503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:12.536239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1381/2688] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:40:12.541973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:12.607437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161b6aa-f3ce-4c09-a4ae-d8d3a0d1e328 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:12.612253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:12.612893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.613179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.613455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.614151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:12.616065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:12.743058 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1308/2689] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:12 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:12.750422 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:12.763920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a20b7-7c57-4540-8d3e-8674b32e30cf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:12.837779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:12.839831 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:12.840292 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:12.841109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:12.842095 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:12.844151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:13.058481 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1382/2690] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:12 2022] POST /identity/v3/users => generated 295 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:13.062821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:13.074370 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33c7c-f5dd-4a0a-9817-c5174f7fc598 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:13.080355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:13.081157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:13.081440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:13.081708 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:13.082356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:13.084184 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:13.098720 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1309/2691] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:13.103791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:13.115974 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319c27-a869-414f-b573-fddb5175408a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:13.121613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:13.122276 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:13.122590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:13.122870 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] PATH_INFO: `/v3/projects/acb58566c0a042d28cf33f40f2700d67/users/fcb94641a594409cb0bfc27950ef4bb7/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:13.151405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb58566c0a042d28cf33f40f2700d67, user_id=fcb94641a594409cb0bfc27950ef4bb7, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:13.154120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:13.193921 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:13.319513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1383/2692] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:13 2022] PUT /identity/v3/projects/acb58566c0a042d28cf33f40f2700d67/users/fcb94641a594409cb0bfc27950ef4bb7/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:13.324401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:13.335513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5205b9-ae04-4ca8-b238-e2e7d0b21af6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:13.399635 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc983b1c-8a08-48be-890f-b5e4d718fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:13.400247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983b1c-8a08-48be-890f-b5e4d718fa3b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:13.400577 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983b1c-8a08-48be-890f-b5e4d718fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:13.400934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983b1c-8a08-48be-890f-b5e4d718fa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:13.401590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc983b1c-8a08-48be-890f-b5e4d718fa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:13.403315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc983b1c-8a08-48be-890f-b5e4d718fa3b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:13.414197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1310/2693] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:40:13.428774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:13.439730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149826-e849-44d8-ae0a-9c33e4044cbe admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:13.444971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:13.445625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:13.448605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:13.448605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] PATH_INFO: `/v3/projects/acb58566c0a042d28cf33f40f2700d67/users/fcb94641a594409cb0bfc27950ef4bb7/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:13.448855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb58566c0a042d28cf33f40f2700d67, user_id=fcb94641a594409cb0bfc27950ef4bb7, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:13.451357 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:13.462219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1384/2694] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:13 2022] PUT /identity/v3/projects/acb58566c0a042d28cf33f40f2700d67/users/fcb94641a594409cb0bfc27950ef4bb7/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:13.473634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:13.473931 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:13.477289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:13.503465 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] MFA Rules not processed for user `fcb94641a594409cb0bfc27950ef4bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:13.504695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:13.580571 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1311/2695] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:13.591989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:13.593775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:13.659641 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39945014-08a2-4486-adc1-3444046b469a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:13.663553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:13.664167 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:13.664453 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:13.664732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:13.729955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:13.731405 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:13.741130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1385/2696] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:14.342385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:15.915001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.925676 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb83af-cc6c-452e-8370-f93a6730c711 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.929435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.930067 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.930354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.930748 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.932918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:15.998830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:16.000288 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:16.012976 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1312/2697] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:16.840897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:16.840897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:16.851064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f522e8-57e9-486f-b2f8-3278d150cf66 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:16.856573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:16.857231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:16.857515 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:16.857793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:16.920201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:16.922027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:16.935348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1386/2698] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:17.051228 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:18.136661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:19.347952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:19.357005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7afe-a186-4d82-8466-0d142a441746 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:19.363922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a20c2-c6f9-4041-abf9-a2b7d9b45710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:19.364863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a20c2-c6f9-4041-abf9-a2b7d9b45710 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:19.365001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a20c2-c6f9-4041-abf9-a2b7d9b45710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:19.365234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a20c2-c6f9-4041-abf9-a2b7d9b45710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:19.378799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a20c2-c6f9-4041-abf9-a2b7d9b45710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:19.381756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a20c2-c6f9-4041-abf9-a2b7d9b45710 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:19.395115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1313/2699] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:19.719141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:22.633493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:24.382534 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:25.564014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:25.630885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583b2fa-50ac-4199-8d1c-ed78d8f760aa service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:25.637042 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:25.637678 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:25.637954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:25.638257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] PATH_INFO: `/v3/users/3feff2958d10403ba7d842717839643c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:25.639414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3feff2958d10403ba7d842717839643c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:25.641479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:25.927310 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3feff2958d10403ba7d842717839643c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:25.942034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3feff2958d10403ba7d842717839643c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:25.950213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3feff2958d10403ba7d842717839643c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:25.951213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3feff2958d10403ba7d842717839643c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:26.061361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3feff2958d10403ba7d842717839643c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:26.071440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1387/2700] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:25 2022] DELETE /identity/v3/users/3feff2958d10403ba7d842717839643c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:26.078027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:26.078802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:26.079205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:26.107703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:26.107703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:26.205236 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1314/2701] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:26.223100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:26.223100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:26.283837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4dbb0-ca6f-4586-9cc5-fac471d3c134 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:26.288064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:26.289395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:26.289395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:26.289395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:26.300400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:26.301897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:26.316498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1388/2702] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:26.587705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:26.903227 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:26.904755 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:26.922980 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d658-544c-4f3a-802a-cd49625b579a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:26.931027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:26.931866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:26.932366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:26.933411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] PATH_INFO: `/v3/projects/9687695439dd4c859110192aecdec529` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:26.935211 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9687695439dd4c859110192aecdec529)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:26.937306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:27.194507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9687695439dd4c859110192aecdec529', 'request_id': 'req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.369938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9687695439dd4c859110192aecdec529', 'request_id': 'req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.377603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9687695439dd4c859110192aecdec529', 'request_id': 'req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.389467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] The token cache is being invalidate because project 9687695439dd4c859110192aecdec529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:27.389768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.390888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.392122 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1315/2703] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:26 2022] DELETE /identity/v3/projects/9687695439dd4c859110192aecdec529 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:27.396605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:27.407383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8fad8-bbb6-4d34-8704-ef68160c0e27 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:27.474381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:27.474381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:27.474728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:27.474728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] PATH_INFO: `/v3/users/21b1701287d24977a7e456abe2c472d4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:27.477372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b1701287d24977a7e456abe2c472d4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:27.477842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:27.751317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b1701287d24977a7e456abe2c472d4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.764517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b1701287d24977a7e456abe2c472d4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.772361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b1701287d24977a7e456abe2c472d4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.773119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b1701287d24977a7e456abe2c472d4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.879002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:27.929543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b1701287d24977a7e456abe2c472d4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:27.938503 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1389/2704] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:27 2022] DELETE /identity/v3/users/21b1701287d24977a7e456abe2c472d4 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:28.595374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:28.597436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:28.611391 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156bfbe-9772-45f4-b4e6-96ee4a1180ec admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:28.680082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:28.680082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:28.680432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:28.680537 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] PATH_INFO: `/v3/projects/88331e30c864440790eb6ebd671d9414` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:28.681895 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88331e30c864440790eb6ebd671d9414)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:28.692027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:28.878893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88331e30c864440790eb6ebd671d9414', 'request_id': 'req-91ad131d-dccc-4c26-97c7-c278f056779e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.061106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88331e30c864440790eb6ebd671d9414', 'request_id': 'req-91ad131d-dccc-4c26-97c7-c278f056779e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.068349 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88331e30c864440790eb6ebd671d9414', 'request_id': 'req-91ad131d-dccc-4c26-97c7-c278f056779e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.084353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] The token cache is being invalidate because project 88331e30c864440790eb6ebd671d9414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:29.084594 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.085422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.087510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1316/2705] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:28 2022] DELETE /identity/v3/projects/88331e30c864440790eb6ebd671d9414 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:29.091912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:29.093858 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:29.114628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ea91-7acb-4568-a893-49f8258c6a83 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:29.185776 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:29.186548 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:29.186941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:29.187227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] PATH_INFO: `/v3/users/fcb94641a594409cb0bfc27950ef4bb7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:29.188434 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb94641a594409cb0bfc27950ef4bb7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:29.190433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:29.862105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb94641a594409cb0bfc27950ef4bb7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.874981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb94641a594409cb0bfc27950ef4bb7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.882091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb94641a594409cb0bfc27950ef4bb7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:29.882846 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb94641a594409cb0bfc27950ef4bb7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:30.026695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb94641a594409cb0bfc27950ef4bb7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:30.033470 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1390/2706] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:29 2022] DELETE /identity/v3/users/fcb94641a594409cb0bfc27950ef4bb7 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:40:30.621794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:30.623325 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:30.638788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad131d-dccc-4c26-97c7-c278f056779e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:30.710072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:30.710737 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:30.713880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:30.713880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] PATH_INFO: `/v3/projects/acb58566c0a042d28cf33f40f2700d67` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:30.713880 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb58566c0a042d28cf33f40f2700d67)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:30.715150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:30.940141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb58566c0a042d28cf33f40f2700d67', 'request_id': 'req-6437e88c-01e2-4e7b-8b0a-d923de790261'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:31.163829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb58566c0a042d28cf33f40f2700d67', 'request_id': 'req-6437e88c-01e2-4e7b-8b0a-d923de790261'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:31.172083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb58566c0a042d28cf33f40f2700d67', 'request_id': 'req-6437e88c-01e2-4e7b-8b0a-d923de790261'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:31.184070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] The token cache is being invalidate because project acb58566c0a042d28cf33f40f2700d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:31.184664 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:31.185567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6437e88c-01e2-4e7b-8b0a-d923de790261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:31.187518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1317/2707] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:30 2022] DELETE /identity/v3/projects/acb58566c0a042d28cf33f40f2700d67 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:31.311821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:31.501602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:35.575838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:36.490205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:37.986668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:39.626688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:39.769551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:39.771157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:39.784942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7a5f-e6d5-4e7b-aa93-c4c9f0d36b98 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:39.849254 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:39.849909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:39.855022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:39.855022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] PATH_INFO: `/v3/users/5d63483b6ba4469ca7191329890bd9d1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:39.855022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d63483b6ba4469ca7191329890bd9d1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:39.855022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:40.236520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d63483b6ba4469ca7191329890bd9d1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:40.252088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d63483b6ba4469ca7191329890bd9d1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:40.260490 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d63483b6ba4469ca7191329890bd9d1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:40.261411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d63483b6ba4469ca7191329890bd9d1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:40.420612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d63483b6ba4469ca7191329890bd9d1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:40.427299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1391/2708] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:39 2022] DELETE /identity/v3/users/5d63483b6ba4469ca7191329890bd9d1 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:40.438036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:40.438036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:40.438036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:40.451991 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:40.453260 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:40.517088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1318/2709] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:40.528047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:40.529617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:40.596374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301acdc-fce2-4372-87b9-e66f7b3bc888 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:40.600050 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:40.600666 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:40.600983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:40.601289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:40.610561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:40.612012 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:40.621536 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1392/2710] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:41.128060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:41.129575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:41.149297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65313d22-2a29-45d1-935b-b4495ac68ea7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:41.155097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:41.155810 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:41.156454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:41.157113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] PATH_INFO: `/v3/projects/74378972543645febbab3924aeb4b855` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:41.158975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74378972543645febbab3924aeb4b855)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:41.163014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:41.313669 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74378972543645febbab3924aeb4b855', 'request_id': 'req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:41.409846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:41.466151 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74378972543645febbab3924aeb4b855', 'request_id': 'req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:41.474097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74378972543645febbab3924aeb4b855', 'request_id': 'req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:41.493487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] The token cache is being invalidate because project 74378972543645febbab3924aeb4b855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:41.494728 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:41.496575 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:41.498805 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1319/2711] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:41 2022] DELETE /identity/v3/projects/74378972543645febbab3924aeb4b855 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:40:41.503271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:41.514720 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786cfec-342f-494a-b3b2-85191005f077 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:41.526767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:41.528333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:41.585285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:41.585960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:41.586245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:41.587024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] PATH_INFO: `/v3/users/c1f494a74e6c435188356c7bae3d4cf1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:41.589404 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f494a74e6c435188356c7bae3d4cf1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:41.592557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:41.598392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c006ab8-7759-4c6c-b1b8-b96a3d50ce5b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:41.599848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:41.600477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:41.600767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:41.601070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:41.603200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:41.677247 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:41.678645 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:41.692938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1320/2712] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:40:42.039852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f494a74e6c435188356c7bae3d4cf1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:42.056103 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f494a74e6c435188356c7bae3d4cf1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:42.068661 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f494a74e6c435188356c7bae3d4cf1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:42.069600 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f494a74e6c435188356c7bae3d4cf1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:42.249374 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f259914c-3dda-4825-bf1d-28401e818b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f494a74e6c435188356c7bae3d4cf1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:42.260298 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1393/2713] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:41 2022] DELETE /identity/v3/users/c1f494a74e6c435188356c7bae3d4cf1 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:42.931128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:42.932872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:42.951949 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b630-d198-4aed-904c-a8bbb770ff87 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:43.019806 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:43.020464 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:43.020753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:43.021241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] PATH_INFO: `/v3/projects/6c8da61ebb084a7295e1248db23aee4e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:43.022614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8da61ebb084a7295e1248db23aee4e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:43.024872 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:43.195225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8da61ebb084a7295e1248db23aee4e', 'request_id': 'req-7415dc83-f973-4c82-a456-951cff97b8ca'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:43.420948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8da61ebb084a7295e1248db23aee4e', 'request_id': 'req-7415dc83-f973-4c82-a456-951cff97b8ca'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:43.421609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:43.433257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8da61ebb084a7295e1248db23aee4e', 'request_id': 'req-7415dc83-f973-4c82-a456-951cff97b8ca'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:43.444327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] The token cache is being invalidate because project 6c8da61ebb084a7295e1248db23aee4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:43.444673 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:43.445812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7415dc83-f973-4c82-a456-951cff97b8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:43.447032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1321/2714] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:42 2022] DELETE /identity/v3/projects/6c8da61ebb084a7295e1248db23aee4e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:43.452842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:43.453160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:43.453486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:43.496419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:43.497790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:43.570644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1394/2715] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:40:43.578780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:43.579071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:43.579419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:43.599373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:43.600597 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:43.609890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1322/2716] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:43.614348 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:43.624741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b416b-d116-4855-8198-1d6bad637065 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:43.629325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:43.629913 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:43.630382 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:43.630559 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:43.631211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:40:43.631545 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:43.633165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:43.647847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1395/2717] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:40:43.654447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:43.664436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5d3e-b924-4774-86fb-3ea93bae058a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:43.670514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:43.671147 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:43.671469 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:43.671782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:43.672583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:43.674725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:43.913941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1323/2718] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:43 2022] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:43.919072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:43.931335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86fcb9-e1ca-43ce-a961-55a0ad3f7372 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:44.000744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:44.001429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:44.003513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:44.003513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:44.003513 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:44.004935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:44.193253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1396/2719] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:43 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:40:44.197657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:44.208830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518854f-dfa9-4486-a4b2-7af69912fa16 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:44.213519 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:44.214144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:44.214425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:44.214703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:44.215346 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:44.217064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:44.227746 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1324/2720] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:40:44.232605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:44.242837 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f408d-148b-4ca7-af39-460f541042ec admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:44.248615 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08689852-baaf-40a3-8827-99233fd6deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:44.255208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08689852-baaf-40a3-8827-99233fd6deba admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:44.255208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08689852-baaf-40a3-8827-99233fd6deba admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:44.255208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08689852-baaf-40a3-8827-99233fd6deba admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:44.255208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08689852-baaf-40a3-8827-99233fd6deba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:44.255208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08689852-baaf-40a3-8827-99233fd6deba admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:44.263532 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1397/2721] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:40:44.269185 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:44.281118 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b765-a3dc-4b76-912b-212a9852adc2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:44.286495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:44.287269 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:44.287493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:44.287762 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] PATH_INFO: `/v3/projects/d529237c587946ebb8b6a128ba2cf49a/users/c9d8a892cfcb43959e8ed850ad4f79fb/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:44.313523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d529237c587946ebb8b6a128ba2cf49a, user_id=c9d8a892cfcb43959e8ed850ad4f79fb, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:44.313523 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:44.518308 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1325/2722] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:44 2022] PUT /identity/v3/projects/d529237c587946ebb8b6a128ba2cf49a/users/c9d8a892cfcb43959e8ed850ad4f79fb/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:44.530473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:44.531266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:44.531716 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:44.565089 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] MFA Rules not processed for user `c9d8a892cfcb43959e8ed850ad4f79fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:44.566607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:44.651878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1398/2723] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:44.657752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:44.727655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b7fc-1f82-4076-8f7f-d074d38ba429 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:44.733427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:44.734061 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:44.734345 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:44.734641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:44.735394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:44.737646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:44.947598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1326/2724] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:44 2022] POST /identity/v3/projects => generated 377 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:44.951238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:44.962688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26059f1-96e7-4e38-b94a-64924ff9d123 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:45.032729 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:45.033338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:45.033642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:45.033919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:45.034699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:45.036872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:45.372746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1399/2725] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:44 2022] POST /identity/v3/users => generated 295 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:45.377569 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:45.390958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eaaef-a35c-40e8-b03c-261d3d25778b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:45.396418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:45.397162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:45.398014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:45.398316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:45.399634 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:45.400770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:45.414174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1327/2726] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:40:45.418369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:45.433140 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a931b-bb31-47f8-8268-91d1b5c6d7cc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:45.439250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:45.440120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:45.440410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:45.440691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] PATH_INFO: `/v3/projects/e83a660de6dd470fa1c14a3d697e032b/users/4639f1e7d5c44184ac367d8825bc6af1/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:45.461799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83a660de6dd470fa1c14a3d697e032b, user_id=4639f1e7d5c44184ac367d8825bc6af1, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:45.467192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:45.770233 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1400/2727] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:45 2022] PUT /identity/v3/projects/e83a660de6dd470fa1c14a3d697e032b/users/4639f1e7d5c44184ac367d8825bc6af1/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:40:45.774324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:45.785752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363df1d7-69a9-431a-98b1-e1ada020153b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:45.861440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac71885-e277-479d-838f-f8904f2b9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:45.862069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac71885-e277-479d-838f-f8904f2b9d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:45.862352 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac71885-e277-479d-838f-f8904f2b9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:45.862632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac71885-e277-479d-838f-f8904f2b9d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:45.864181 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac71885-e277-479d-838f-f8904f2b9d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:45.865092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac71885-e277-479d-838f-f8904f2b9d3f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:45.880903 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1328/2728] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:45.881741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:45.894529 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dabd2a-e66a-4784-8eae-e3a97043c572 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:45.900944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:45.900944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:45.902489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:45.902489 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] PATH_INFO: `/v3/projects/e83a660de6dd470fa1c14a3d697e032b/users/4639f1e7d5c44184ac367d8825bc6af1/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:45.904703 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83a660de6dd470fa1c14a3d697e032b, user_id=4639f1e7d5c44184ac367d8825bc6af1, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:45.907474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:45.921387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1401/2729] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:45 2022] PUT /identity/v3/projects/e83a660de6dd470fa1c14a3d697e032b/users/4639f1e7d5c44184ac367d8825bc6af1/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:45.931919 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:45.932213 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:45.932532 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:45.973088 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] MFA Rules not processed for user `4639f1e7d5c44184ac367d8825bc6af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:45.976408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:46.060718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1329/2730] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:46.075723 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:46.078238 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:46.149063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4602df0-a197-4c80-8cb9-dd16004dd334 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:46.153104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:46.153763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:46.154061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:46.154342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:46.223960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:46.225558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:46.235712 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1402/2731] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:47.798241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:47.975009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:50.850990 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:50.852499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:50.925455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa915-6ab6-4a46-9bed-ab109da41b9a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:50.930835 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:50.931476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:50.931760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:50.932552 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] PATH_INFO: `/v3/users/b008b2bb292545d79c0f316214056f72` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:50.933754 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b008b2bb292545d79c0f316214056f72)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:50.935699 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:51.228890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b008b2bb292545d79c0f316214056f72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:51.229593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b008b2bb292545d79c0f316214056f72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:51.243243 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b008b2bb292545d79c0f316214056f72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:51.251393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b008b2bb292545d79c0f316214056f72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:51.252218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b008b2bb292545d79c0f316214056f72'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:51.358037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1330/2732] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:50 2022] DELETE /identity/v3/users/b008b2bb292545d79c0f316214056f72 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:51.472599 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:51.482553 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecec20-a4ce-4d9e-a3dd-c968b0613198 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:51.560597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:51.561284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:51.561563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:51.561834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:51.563620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:51.630745 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:51.632224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:51.642569 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1403/2733] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:51.679936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:51.681435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:51.751447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a587f-4a0c-4103-be7a-b642ded82806 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:51.756162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:51.756797 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:51.757103 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:51.757372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] PATH_INFO: `/v3/projects/027334234ddf4e5ca37d821ba4294fc9` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:51.759071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027334234ddf4e5ca37d821ba4294fc9)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:51.763600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:51.832208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:51.976390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027334234ddf4e5ca37d821ba4294fc9', 'request_id': 'req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:51.997653 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:52.095413 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027334234ddf4e5ca37d821ba4294fc9', 'request_id': 'req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.105600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027334234ddf4e5ca37d821ba4294fc9', 'request_id': 'req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.118084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] The token cache is being invalidate because project 027334234ddf4e5ca37d821ba4294fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:52.118390 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.119084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.121602 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1331/2734] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:51 2022] DELETE /identity/v3/projects/027334234ddf4e5ca37d821ba4294fc9 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:52.125881 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:52.140204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3446f10-ed6c-4bfb-a4a7-fea5317a3ef0 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:52.210731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:52.211417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:52.211711 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:52.212010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] PATH_INFO: `/v3/users/7b4ee1596f684a33a900d327e7d3d6c5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:52.213621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4ee1596f684a33a900d327e7d3d6c5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:52.215721 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:52.594287 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4ee1596f684a33a900d327e7d3d6c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.606692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4ee1596f684a33a900d327e7d3d6c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.614270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4ee1596f684a33a900d327e7d3d6c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.614999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4ee1596f684a33a900d327e7d3d6c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.768989 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b46a66c1-dc90-4c3c-9efe-219eb0c5067e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4ee1596f684a33a900d327e7d3d6c5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:52.776594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1404/2735] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:52 2022] DELETE /identity/v3/users/7b4ee1596f684a33a900d327e7d3d6c5 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:53.073795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:53.075670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:53.094770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379cbf7-c95b-4901-a7c1-c70c3cd81e68 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:53.169965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:53.170518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:53.170799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:53.171130 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] PATH_INFO: `/v3/projects/734687c6c7624646a198a68b020e0818` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:53.172297 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734687c6c7624646a198a68b020e0818)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:53.174253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:53.433116 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734687c6c7624646a198a68b020e0818', 'request_id': 'req-a2f014de-f6a2-48bd-a55c-fe70e85f1740'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:53.665775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734687c6c7624646a198a68b020e0818', 'request_id': 'req-a2f014de-f6a2-48bd-a55c-fe70e85f1740'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:53.673086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734687c6c7624646a198a68b020e0818', 'request_id': 'req-a2f014de-f6a2-48bd-a55c-fe70e85f1740'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:53.687081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] The token cache is being invalidate because project 734687c6c7624646a198a68b020e0818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:53.687321 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:53.688387 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a2f014de-f6a2-48bd-a55c-fe70e85f1740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:53.689955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1332/2736] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:53 2022] DELETE /identity/v3/projects/734687c6c7624646a198a68b020e0818 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:53.697860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:53.699125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:53.699285 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:53.719702 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:53.721059 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:53.791910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1405/2737] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:53.800038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:53.800350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:53.800627 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:53.821760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:53.822977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:53.831616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1333/2738] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:53.838135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:53.852052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f1c8-dac5-4459-a2ed-b467d57646cf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:53.857206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:53.857830 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:53.858113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:53.858386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:53.859083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:40:53.859511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:53.861247 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:53.874120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1406/2739] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:40:53.878500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:53.889395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27af42-0046-43b6-820f-4b588ede0d96 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:53.894327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:53.894948 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:53.895230 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:53.895508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:53.896143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:53.898096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:54.085593 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1334/2740] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:53 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:54.090221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:54.106364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8a51b-e1bc-49f8-a609-939160b7ace7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:54.175051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:54.175671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:54.175952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:54.176227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:54.176898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:54.178820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:54.243967 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:54.301115 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1407/2741] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:54 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:54.305862 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:54.317986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c9f1-1626-4c8a-89ee-55436b7cb00a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:54.323372 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:54.324021 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:54.324303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:54.324565 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:54.325284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:54.327175 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:54.335526 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:54.341407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1335/2742] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:54.353954 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:54.367025 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a19e5-a7fb-4c38-8b1a-b3f95ccca813 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:54.372958 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29753452-aceb-4222-80cf-02c25f89b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:54.373593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29753452-aceb-4222-80cf-02c25f89b303 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:54.373878 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29753452-aceb-4222-80cf-02c25f89b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:54.374152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29753452-aceb-4222-80cf-02c25f89b303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:54.374810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29753452-aceb-4222-80cf-02c25f89b303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:54.376483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29753452-aceb-4222-80cf-02c25f89b303 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:54.388302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1408/2743] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:54.393208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:54.404224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9495-5d70-4d3d-8258-0b3ad9be8c49 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:54.408915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:54.409572 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:54.409852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:54.410138 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] PATH_INFO: `/v3/projects/8fe399c96a624750a66082d19e78ed64/users/f86244ee1df7450586ef0d77b79b0921/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:54.426146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe399c96a624750a66082d19e78ed64, user_id=f86244ee1df7450586ef0d77b79b0921, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:54.428856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:54.610177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1336/2744] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:54 2022] PUT /identity/v3/projects/8fe399c96a624750a66082d19e78ed64/users/f86244ee1df7450586ef0d77b79b0921/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:40:54.624429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:54.624694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:54.625051 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:54.654687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] MFA Rules not processed for user `f86244ee1df7450586ef0d77b79b0921`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:54.656636 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:54.729753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1409/2745] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:40:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:40:54.742009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:54.743770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:54.806002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ee68e-3626-4190-b851-c082af26c20f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:54.812303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768495-c4b9-49ac-8e20-9b4198f0873e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:54.813114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768495-c4b9-49ac-8e20-9b4198f0873e service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:54.813499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768495-c4b9-49ac-8e20-9b4198f0873e service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:54.813870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768495-c4b9-49ac-8e20-9b4198f0873e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:54.823698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768495-c4b9-49ac-8e20-9b4198f0873e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:54.825373 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768495-c4b9-49ac-8e20-9b4198f0873e service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:54.834912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1337/2746] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:56.357716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:57.420597 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:58.803303 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:58.917802 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:01.035842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:01.108452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d6ae2-40a0-4600-b5ae-6ed258ec0af8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:01.113908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:01.114575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:01.114855 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:01.115133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] PATH_INFO: `/v3/users/f86244ee1df7450586ef0d77b79b0921` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:01.116339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86244ee1df7450586ef0d77b79b0921)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:01.118284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:01.553427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86244ee1df7450586ef0d77b79b0921'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:01.566393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86244ee1df7450586ef0d77b79b0921'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:01.573591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86244ee1df7450586ef0d77b79b0921'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:01.574950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86244ee1df7450586ef0d77b79b0921'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:01.728706 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86244ee1df7450586ef0d77b79b0921'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:01.735670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1410/2747] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:01 2022] DELETE /identity/v3/users/f86244ee1df7450586ef0d77b79b0921 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:01.741132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:01.741544 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:01.741701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:01.762808 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:01.764016 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:01.823389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1338/2748] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:01.838665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:01.841200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:01.909267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ece31-4a20-498e-bb93-3aaf5e067ebe admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:01.914346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf9fa-4cdb-42ed-9793-127642e8d7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:01.914972 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf9fa-4cdb-42ed-9793-127642e8d7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:01.915255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf9fa-4cdb-42ed-9793-127642e8d7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:01.915539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf9fa-4cdb-42ed-9793-127642e8d7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:01.926753 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf9fa-4cdb-42ed-9793-127642e8d7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:01.928218 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf9fa-4cdb-42ed-9793-127642e8d7b7 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:01.939692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1411/2749] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:02.553353 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:02.554790 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:02.569767 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c6c2a-61d5-4030-a745-3ba145c4f54a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:02.574498 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:02.575144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:02.575427 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:02.575707 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] PATH_INFO: `/v3/projects/8fe399c96a624750a66082d19e78ed64` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:02.576904 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe399c96a624750a66082d19e78ed64)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:02.578932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:02.711685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:02.765916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe399c96a624750a66082d19e78ed64', 'request_id': 'req-2766d160-30db-4340-b839-0d18db0720a9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:02.791168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:02.865398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe399c96a624750a66082d19e78ed64', 'request_id': 'req-2766d160-30db-4340-b839-0d18db0720a9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:02.872499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe399c96a624750a66082d19e78ed64', 'request_id': 'req-2766d160-30db-4340-b839-0d18db0720a9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:02.884505 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] The token cache is being invalidate because project 8fe399c96a624750a66082d19e78ed64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:02.884821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:02.885536 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2766d160-30db-4340-b839-0d18db0720a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:02.887234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1339/2750] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:02 2022] DELETE /identity/v3/projects/8fe399c96a624750a66082d19e78ed64 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:02.892334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:02.892644 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:02.892955 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:02.913613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:02.914921 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:02.990791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1412/2751] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:41:02.991376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:02.991376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:02.991376 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.010107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:03.011380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:03.020012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1340/2752] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:03.045372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.055761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfb47e-3759-4d19-8d7b-9df58588bd7c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.064479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.065172 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.065451 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.065724 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.066384 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:41:03.066759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.068562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.086957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1413/2753] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:41:03.092518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.102479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e74a25-fccf-494b-a020-7ef88ba39ec8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.107821 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.110704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.110704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.110704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.110704 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.111723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.273668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1341/2754] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:03 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:03.278401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.288493 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650abd6-c9a6-4bf3-b5e2-00d25925c1bd admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.346871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.347474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.347755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.348033 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.348677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.350629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.448520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1414/2755] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:03 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:03.453538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.464101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde98f8-e8ce-4dee-be35-1ae6a25c45be admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.468769 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.469403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.469753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.470027 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.470710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.472368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.483129 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1342/2756] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:03.488425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.499763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c709-1558-4ad3-867c-3148df24ed63 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.504598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7aea-d005-4450-bcce-3636ea2ba724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.505256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7aea-d005-4450-bcce-3636ea2ba724 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.505540 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7aea-d005-4450-bcce-3636ea2ba724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.505840 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7aea-d005-4450-bcce-3636ea2ba724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.506619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7aea-d005-4450-bcce-3636ea2ba724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.508497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7aea-d005-4450-bcce-3636ea2ba724 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.520492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1415/2757] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:03.524914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.535052 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7556-71bc-40ea-a387-9d609d0fb800 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.540344 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.541040 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.541334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.541613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] PATH_INFO: `/v3/projects/755eaa5f209743ed90945b803b3a5b00/users/2c704ba285c647e8a47f8a3efd284c25/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.563051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755eaa5f209743ed90945b803b3a5b00, user_id=2c704ba285c647e8a47f8a3efd284c25, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.565765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.725322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1343/2758] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:03 2022] PUT /identity/v3/projects/755eaa5f209743ed90945b803b3a5b00/users/2c704ba285c647e8a47f8a3efd284c25/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:03.793936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.794486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.794486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.822915 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] MFA Rules not processed for user `2c704ba285c647e8a47f8a3efd284c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:03.824228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:03.888827 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1416/2759] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:03.900522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:03.902499 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:03.964657 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e6b8-09cf-45dc-aaa0-a895c2123859 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:03.968637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b5059-1d64-47ed-b8f3-c96d610edabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:03.969375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5059-1d64-47ed-b8f3-c96d610edabd service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:03.969662 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5059-1d64-47ed-b8f3-c96d610edabd service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:03.969934 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5059-1d64-47ed-b8f3-c96d610edabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:03.978674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b5059-1d64-47ed-b8f3-c96d610edabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:03.979988 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b5059-1d64-47ed-b8f3-c96d610edabd service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:03.989771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1344/2760] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:04.015415 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:04.082956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58011e0-fb9a-4671-af91-d4d9d04ba07c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:04.087982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:04.088633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:04.088961 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:04.089242 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] PATH_INFO: `/v3/users/2c704ba285c647e8a47f8a3efd284c25` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:04.090902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c704ba285c647e8a47f8a3efd284c25)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:04.094910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:04.330769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:04.350585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c704ba285c647e8a47f8a3efd284c25'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:04.371849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c704ba285c647e8a47f8a3efd284c25'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:04.382461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c704ba285c647e8a47f8a3efd284c25'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:04.383742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c704ba285c647e8a47f8a3efd284c25'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:04.495781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c704ba285c647e8a47f8a3efd284c25'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:04.505947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1417/2761] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:04 2022] DELETE /identity/v3/users/2c704ba285c647e8a47f8a3efd284c25 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:04.512443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e32e-468b-4048-a434-d8570755e45a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:04.512876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e32e-468b-4048-a434-d8570755e45a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:04.513902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e32e-468b-4048-a434-d8570755e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:04.535560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4581e32e-468b-4048-a434-d8570755e45a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:04.536936 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4581e32e-468b-4048-a434-d8570755e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:04.598314 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1345/2762] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:04.608182 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:04.610142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:04.669086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04c6e6-1375-4e68-b713-575e5f3b429c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:04.672767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:04.673403 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:04.673691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:04.673971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:04.683019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:04.684505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:04.694522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1418/2763] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:04.917560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:05.336220 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581e32e-468b-4048-a434-d8570755e45a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:05.345115 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4581e32e-468b-4048-a434-d8570755e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:05.352257 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581e32e-468b-4048-a434-d8570755e45a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:05.358000 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:05.358667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:05.358999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:05.359244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] PATH_INFO: `/v3/projects/755eaa5f209743ed90945b803b3a5b00` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:05.360478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755eaa5f209743ed90945b803b3a5b00)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:05.362496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:05.548146 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755eaa5f209743ed90945b803b3a5b00', 'request_id': 'req-3e43db11-6b62-4660-b5c8-8bd8786ce285'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:05.665356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755eaa5f209743ed90945b803b3a5b00', 'request_id': 'req-3e43db11-6b62-4660-b5c8-8bd8786ce285'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:05.673570 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755eaa5f209743ed90945b803b3a5b00', 'request_id': 'req-3e43db11-6b62-4660-b5c8-8bd8786ce285'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:05.684351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] The token cache is being invalidate because project 755eaa5f209743ed90945b803b3a5b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:05.684644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:05.685318 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3e43db11-6b62-4660-b5c8-8bd8786ce285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:05.686844 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1346/2764] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:05 2022] DELETE /identity/v3/projects/755eaa5f209743ed90945b803b3a5b00 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:05.722239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:06.814127 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:06.911252 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:07.837329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:08.448794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:08.676221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:08.677758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:08.691397 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645db7-4559-4474-afe5-6fd041dfe3ca service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:08.748132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:08.748968 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:08.749295 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:08.749832 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] PATH_INFO: `/v3/users/c9d8a892cfcb43959e8ed850ad4f79fb` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:08.751018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d8a892cfcb43959e8ed850ad4f79fb)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:08.753023 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:08.942022 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d8a892cfcb43959e8ed850ad4f79fb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:08.953741 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d8a892cfcb43959e8ed850ad4f79fb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:08.960460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d8a892cfcb43959e8ed850ad4f79fb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:08.961237 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d8a892cfcb43959e8ed850ad4f79fb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:08.963054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:09.093940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d8a892cfcb43959e8ed850ad4f79fb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:09.100339 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1419/2765] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:08 2022] DELETE /identity/v3/users/c9d8a892cfcb43959e8ed850ad4f79fb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:09.106836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:09.106836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:09.106836 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:09.126500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:09.127695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:09.189479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1347/2766] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:09.199398 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:09.200919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:09.259213 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ed3f8-28b5-46ae-8ce8-c3514facdf57 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:09.262862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:09.264175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:09.264175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:09.264175 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:09.273317 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:09.274744 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:09.284718 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1420/2767] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:09.369053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:09.765442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:09.766918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:09.779740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ddbf8-ba3e-4b55-bc05-5e660aac84dd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:09.784442 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:09.785125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:09.785538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:09.785824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] PATH_INFO: `/v3/projects/d529237c587946ebb8b6a128ba2cf49a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:09.786954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d529237c587946ebb8b6a128ba2cf49a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:09.788939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:09.980096 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd529237c587946ebb8b6a128ba2cf49a', 'request_id': 'req-066bf29e-adba-4f18-85f4-15f489b49744'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.094732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:10.151166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd529237c587946ebb8b6a128ba2cf49a', 'request_id': 'req-066bf29e-adba-4f18-85f4-15f489b49744'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.158073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd529237c587946ebb8b6a128ba2cf49a', 'request_id': 'req-066bf29e-adba-4f18-85f4-15f489b49744'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.170466 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] The token cache is being invalidate because project d529237c587946ebb8b6a128ba2cf49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:10.170854 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.171414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.172973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1348/2768] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:09 2022] DELETE /identity/v3/projects/d529237c587946ebb8b6a128ba2cf49a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:10.177607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:10.192940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a828-b7a7-429b-938d-6999cab092b1 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:10.254860 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:10.255497 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:10.255786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:10.256062 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] PATH_INFO: `/v3/users/4639f1e7d5c44184ac367d8825bc6af1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:10.257286 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4639f1e7d5c44184ac367d8825bc6af1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:10.259519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:10.300028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:10.520094 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4639f1e7d5c44184ac367d8825bc6af1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.532047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4639f1e7d5c44184ac367d8825bc6af1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.539345 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4639f1e7d5c44184ac367d8825bc6af1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.540101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4639f1e7d5c44184ac367d8825bc6af1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.705372 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cbef5f47-7825-448f-9a54-7e3befe6c2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4639f1e7d5c44184ac367d8825bc6af1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:10.712320 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1421/2769] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:10 2022] DELETE /identity/v3/users/4639f1e7d5c44184ac367d8825bc6af1 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:10.803105 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:11.171114 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:11.173348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:11.192201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bf29e-adba-4f18-85f4-15f489b49744 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:11.208942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:11.263266 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:11.264036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:11.264263 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:11.264547 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] PATH_INFO: `/v3/projects/e83a660de6dd470fa1c14a3d697e032b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:11.265753 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83a660de6dd470fa1c14a3d697e032b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:11.267701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:11.414912 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83a660de6dd470fa1c14a3d697e032b', 'request_id': 'req-3c5af97b-f56f-4409-b570-597934e73b07'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:11.528906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83a660de6dd470fa1c14a3d697e032b', 'request_id': 'req-3c5af97b-f56f-4409-b570-597934e73b07'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:11.536992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83a660de6dd470fa1c14a3d697e032b', 'request_id': 'req-3c5af97b-f56f-4409-b570-597934e73b07'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:11.552794 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] The token cache is being invalidate because project e83a660de6dd470fa1c14a3d697e032b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:11.553137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:11.553956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3c5af97b-f56f-4409-b570-597934e73b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:11.556492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1349/2770] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:11 2022] DELETE /identity/v3/projects/e83a660de6dd470fa1c14a3d697e032b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:11.563387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:11.565953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:11.565953 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:11.590438 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:11.592343 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:11.614675 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:11.653603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1422/2771] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:41:11.662624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:11.662941 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:11.663222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:11.683395 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:11.685048 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:11.693216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1350/2772] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:11.698227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:11.709253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27a786-78ea-4b21-9310-fa0ee9c2f120 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:11.718852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:11.718852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:11.718852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:11.718852 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:11.719223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:41:11.719223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:11.719223 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:11.731810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1423/2773] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:41:11.738102 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:11.749239 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a789a96-3672-4a39-bba3-3fdedce7960a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:11.754150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:11.754758 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:11.755071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:11.755348 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:11.756095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:11.758458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:11.928491 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:11.936379 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1351/2774] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:11 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:11.941619 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:11.952393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb673be2-a7b4-4adc-97b5-8c33bc1f8cbb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:12.015814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:12.016417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.016697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.017014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.017642 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:12.019725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:12.157344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1424/2775] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:11 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:12.161727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:12.178932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9f07-ef5f-4043-b16c-e8c94b2a7756 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:12.185171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:12.186006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.186751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.187010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.187666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:12.189473 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:12.202371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1352/2776] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:12.209420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:12.219932 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5210808-3e59-47cd-ba8e-9a77e78a9830 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:12.226359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6222eb5-a406-4f70-907c-fb352383d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:12.231674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6222eb5-a406-4f70-907c-fb352383d06f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.231674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6222eb5-a406-4f70-907c-fb352383d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.231674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6222eb5-a406-4f70-907c-fb352383d06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.231674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6222eb5-a406-4f70-907c-fb352383d06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:12.231674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6222eb5-a406-4f70-907c-fb352383d06f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:12.243065 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1425/2777] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:12.249600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:12.262907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8348c-9525-4a0b-9b3c-4b60062d8d48 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:12.268234 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:12.269006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.269287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.269566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] PATH_INFO: `/v3/projects/b2686c2217934ab7a13beb03c42720d2/users/0b1e09186f16434e872dfb96b1c3545b/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.286989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2686c2217934ab7a13beb03c42720d2, user_id=0b1e09186f16434e872dfb96b1c3545b, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:12.289842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:12.317580 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:12.457018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1353/2778] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:12 2022] PUT /identity/v3/projects/b2686c2217934ab7a13beb03c42720d2/users/0b1e09186f16434e872dfb96b1c3545b/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:12.469075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea391-f554-4d66-93c8-606233815cfd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.469486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea391-f554-4d66-93c8-606233815cfd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.469853 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea391-f554-4d66-93c8-606233815cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.488589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:12.499401 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-090ea391-f554-4d66-93c8-606233815cfd None None] MFA Rules not processed for user `0b1e09186f16434e872dfb96b1c3545b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:12.501137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-090ea391-f554-4d66-93c8-606233815cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:12.586704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1426/2779] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:41:12.592183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:12.656478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:12.662320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86aea4-6701-4dd9-b473-b99efcdeda9a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:12.667652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:12.668843 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.669134 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.669459 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.670106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:12.672306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:12.684986 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:12.804527 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1354/2780] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:12 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:41:12.809297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ea391-f554-4d66-93c8-606233815cfd None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:12.820391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ea391-f554-4d66-93c8-606233815cfd None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:12.878621 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:12.879226 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:12.879504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:12.879781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:12.880418 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:12.882514 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:13.055010 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1427/2781] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:12 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:41:13.059371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:13.069893 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cfbf5-f4c2-41cd-8207-93d55c9e0f1a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:13.075697 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:13.075840 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:13.076065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.076343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.076613 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.077322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:13.078929 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:13.096133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1355/2782] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:13.102180 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:13.112794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7674269-f3c1-424c-9a0c-5034eae8f14f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:13.117508 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:13.118174 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.118461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.118738 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] PATH_INFO: `/v3/projects/fc0d4aae25cb4345b00912f2aca54a87/users/cf56583b413c422f909f21903d0eb4c9/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.139206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0d4aae25cb4345b00912f2aca54a87, user_id=cf56583b413c422f909f21903d0eb4c9, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:13.142009 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:13.145702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:13.249764 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1428/2783] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:13 2022] PUT /identity/v3/projects/fc0d4aae25cb4345b00912f2aca54a87/users/cf56583b413c422f909f21903d0eb4c9/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:13.254082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:13.265868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015f7b-355f-4151-954e-a6357713e197 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:13.325799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9add9e-e413-4622-ae6f-513c9c7ae095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:13.327932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9add9e-e413-4622-ae6f-513c9c7ae095 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.327932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9add9e-e413-4622-ae6f-513c9c7ae095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.327932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9add9e-e413-4622-ae6f-513c9c7ae095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.327932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9add9e-e413-4622-ae6f-513c9c7ae095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:13.329396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9add9e-e413-4622-ae6f-513c9c7ae095 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:13.339680 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1356/2784] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:13.343944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:13.355779 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769428ea-2e4b-4dff-89c4-90824c18a0ae admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:13.360625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:13.361563 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.361704 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.361914 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] PATH_INFO: `/v3/projects/fc0d4aae25cb4345b00912f2aca54a87/users/cf56583b413c422f909f21903d0eb4c9/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.363998 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0d4aae25cb4345b00912f2aca54a87, user_id=cf56583b413c422f909f21903d0eb4c9, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:13.366739 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:13.377820 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1429/2785] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:13 2022] PUT /identity/v3/projects/fc0d4aae25cb4345b00912f2aca54a87/users/cf56583b413c422f909f21903d0eb4c9/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:13.385623 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:13.389930 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.390221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.390503 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.420484 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:13.420741 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] MFA Rules not processed for user `cf56583b413c422f909f21903d0eb4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:13.421945 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:13.499900 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1357/2786] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:13.512091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:13.513924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:13.577011 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa052-0554-4034-ad70-ee2886599a23 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:13.580742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625fe8-d089-4012-ae95-fdfbc506837e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:13.581388 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625fe8-d089-4012-ae95-fdfbc506837e service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.581664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625fe8-d089-4012-ae95-fdfbc506837e service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.581936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625fe8-d089-4012-ae95-fdfbc506837e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.593668 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27625fe8-d089-4012-ae95-fdfbc506837e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:13.595119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27625fe8-d089-4012-ae95-fdfbc506837e service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:13.605151 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1430/2787] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:13.659789 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:13.678461 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:13.724750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:13.758817 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3605ea-25bf-4346-8132-40f490b33537 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:13.763788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:13.764421 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:13.764698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:13.765004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] PATH_INFO: `/v3/users/0b1e09186f16434e872dfb96b1c3545b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:13.766154 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1e09186f16434e872dfb96b1c3545b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:13.768142 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:14.184411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1e09186f16434e872dfb96b1c3545b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:14.185225 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1e09186f16434e872dfb96b1c3545b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:14.200422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1e09186f16434e872dfb96b1c3545b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:14.208097 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1e09186f16434e872dfb96b1c3545b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:14.209200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1e09186f16434e872dfb96b1c3545b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:14.322078 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1358/2788] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:13 2022] DELETE /identity/v3/users/0b1e09186f16434e872dfb96b1c3545b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:14.327499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:14.328220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:14.328220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:14.348289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:14.356691 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:14.392377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:14.418888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1431/2789] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:41:14.429484 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:14.430926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:14.455909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:14.502910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6326ac9-7dad-40e9-9250-2f3d37e9018d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:14.506551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:14.507162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:14.507483 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:14.507807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:14.519361 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:14.520885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:14.531229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1359/2790] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:14.773882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:14.928355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:15.047293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:15.049639 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:15.067396 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745394a-abed-4abb-bc29-b14e42b07f7f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:15.072492 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:15.073205 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:15.073463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:15.073742 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] PATH_INFO: `/v3/projects/b2686c2217934ab7a13beb03c42720d2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:15.074923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2686c2217934ab7a13beb03c42720d2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:15.076898 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:15.207256 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2686c2217934ab7a13beb03c42720d2', 'request_id': 'req-3bceac82-d359-43ba-8ea3-35e4e553ce17'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.288605 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2686c2217934ab7a13beb03c42720d2', 'request_id': 'req-3bceac82-d359-43ba-8ea3-35e4e553ce17'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.297203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2686c2217934ab7a13beb03c42720d2', 'request_id': 'req-3bceac82-d359-43ba-8ea3-35e4e553ce17'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.308848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] The token cache is being invalidate because project b2686c2217934ab7a13beb03c42720d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:15.314075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.314075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.314075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:15.314075 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1432/2791] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:15 2022] DELETE /identity/v3/projects/b2686c2217934ab7a13beb03c42720d2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:15.321631 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:15.332112 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce888e-5280-4da5-beef-37ccdcb846f2 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:15.398128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:15.398992 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:15.399335 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:15.399644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] PATH_INFO: `/v3/users/cf56583b413c422f909f21903d0eb4c9` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:15.400977 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf56583b413c422f909f21903d0eb4c9)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:15.403510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:15.658956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf56583b413c422f909f21903d0eb4c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.659691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf56583b413c422f909f21903d0eb4c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.672695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf56583b413c422f909f21903d0eb4c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.679781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf56583b413c422f909f21903d0eb4c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.687343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d81e9e03-c9b8-486d-bb5e-4b3bf9b1ca42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf56583b413c422f909f21903d0eb4c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:15.786014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1360/2792] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:15 2022] DELETE /identity/v3/users/cf56583b413c422f909f21903d0eb4c9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:16.090229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:16.281121 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:16.285284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:16.304482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceac82-d359-43ba-8ea3-35e4e553ce17 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:16.376896 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:16.377531 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:16.377812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:16.378119 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] PATH_INFO: `/v3/projects/fc0d4aae25cb4345b00912f2aca54a87` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:16.379279 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0d4aae25cb4345b00912f2aca54a87)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:16.381221 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:16.416244 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:16.515018 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0d4aae25cb4345b00912f2aca54a87', 'request_id': 'req-d8318f18-6843-4252-8e18-56ffe6a4b7e1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:16.574506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0d4aae25cb4345b00912f2aca54a87', 'request_id': 'req-d8318f18-6843-4252-8e18-56ffe6a4b7e1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:16.582943 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0d4aae25cb4345b00912f2aca54a87', 'request_id': 'req-d8318f18-6843-4252-8e18-56ffe6a4b7e1'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:16.595290 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] The token cache is being invalidate because project fc0d4aae25cb4345b00912f2aca54a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:16.595588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:16.596266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d8318f18-6843-4252-8e18-56ffe6a4b7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:16.597861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1433/2793] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:16 2022] DELETE /identity/v3/projects/fc0d4aae25cb4345b00912f2aca54a87 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:16.604136 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:16.604624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:16.605119 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:16.628145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:16.630271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:16.651818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:16.665801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:16.702326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1361/2794] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:16.710671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171fa56-b801-4707-b609-7dad48f597be None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:16.711063 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171fa56-b801-4707-b609-7dad48f597be None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:16.711346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171fa56-b801-4707-b609-7dad48f597be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:16.732429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1171fa56-b801-4707-b609-7dad48f597be None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:16.734812 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1171fa56-b801-4707-b609-7dad48f597be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:16.742924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1434/2795] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:16.750411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:16.762241 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0de8c-d80c-4287-aa4b-6bff09f7bfa1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:16.767267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:16.767952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:16.768437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:16.768779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:16.769955 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:41:16.770360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:16.772156 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:16.785065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1362/2796] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:41:16.789939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171fa56-b801-4707-b609-7dad48f597be None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:16.799411 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171fa56-b801-4707-b609-7dad48f597be None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:16.804414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:16.805038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:16.805319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:16.805593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:16.806266 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:16.808971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:16.866206 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:16.953928 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1435/2797] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:16 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:16.959524 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:16.969137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:16.973023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab846732-71cc-4697-b073-5658d41914bc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:17.037576 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:17.038479 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.038763 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.039038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.039690 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:17.041760 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:17.225801 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1363/2798] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:16 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:41:17.230923 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:17.237860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:17.242083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ff27d-97b8-4857-9314-ce8100772f00 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:17.247965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:17.248571 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.248939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.249217 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.249862 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:17.251480 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:17.262809 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1436/2799] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:17.267323 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:17.277557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8c5d-3296-473d-b3f0-e0f24c1a0371 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:17.282255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17545b-afd3-4faf-acbc-612a6fe7eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:17.282851 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17545b-afd3-4faf-acbc-612a6fe7eada admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.283128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17545b-afd3-4faf-acbc-612a6fe7eada admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.283397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17545b-afd3-4faf-acbc-612a6fe7eada admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.284038 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17545b-afd3-4faf-acbc-612a6fe7eada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:17.285660 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17545b-afd3-4faf-acbc-612a6fe7eada admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:17.297060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1364/2800] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:17.302752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:17.311561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:17.315819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4638086-4507-4289-b714-cb10c0706394 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:17.320769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:17.321510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.321815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.322101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] PATH_INFO: `/v3/projects/06393b5043d74a7f8ce60460bac72e01/users/3a40c71d0d65455caa1b5964750a3b8a/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.342353 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06393b5043d74a7f8ce60460bac72e01, user_id=3a40c71d0d65455caa1b5964750a3b8a, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:17.345229 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:17.450047 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1437/2801] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:17 2022] PUT /identity/v3/projects/06393b5043d74a7f8ce60460bac72e01/users/3a40c71d0d65455caa1b5964750a3b8a/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:17.460881 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.461162 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.461430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.492618 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] MFA Rules not processed for user `3a40c71d0d65455caa1b5964750a3b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:17.493796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:17.565081 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1365/2802] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:17.573096 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:17.637888 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:17.643875 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188598-f688-4a04-b7f7-3c782c432ef7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:17.649156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:17.649775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.650061 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.650342 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.650992 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:17.653591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:17.677351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:17.766427 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1438/2803] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:17 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:17.770549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:17.781906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85343074-6f56-4319-b377-8f44e0b525a3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:17.840860 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:17.841538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:17.841824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:17.842111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:17.842795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:17.844776 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:17.980277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1366/2804] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:17 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:17.995725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.006351 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2967-370c-4a94-a5af-db4d3462a080 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.012464 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.013104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.014131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.014701 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.015781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.017672 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:18.030253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1439/2805] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:18.034993 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.047065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175786f-8811-4a3d-b20f-bf6f58e885b2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.051849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde850b-7ae0-406f-a3e2-d3ec3a09488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.052446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde850b-7ae0-406f-a3e2-d3ec3a09488c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.052726 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde850b-7ae0-406f-a3e2-d3ec3a09488c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.053029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde850b-7ae0-406f-a3e2-d3ec3a09488c admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.053727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde850b-7ae0-406f-a3e2-d3ec3a09488c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.055327 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde850b-7ae0-406f-a3e2-d3ec3a09488c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:18.066164 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1367/2806] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:18.070432 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.081476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3216cb1-98bb-479c-8b24-94bd9b9d00a7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.086200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.086892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.087169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.087447 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] PATH_INFO: `/v3/projects/57f3186013a34b4b9290bbdbc7eab97a/users/f6024bca20cd4384bcfa6585f11ad69b/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.107381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f3186013a34b4b9290bbdbc7eab97a, user_id=f6024bca20cd4384bcfa6585f11ad69b, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.110188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:18.145617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:18.186304 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1440/2807] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:18 2022] PUT /identity/v3/projects/57f3186013a34b4b9290bbdbc7eab97a/users/f6024bca20cd4384bcfa6585f11ad69b/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:18.197975 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.198309 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.204149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.230174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] MFA Rules not processed for user `f6024bca20cd4384bcfa6585f11ad69b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:18.231455 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:18.298873 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1368/2808] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:18.303640 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.320458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:18.374572 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121301-2849-4b64-ac0b-3343fd7816b0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.379425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.380029 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.380313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.380592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.381271 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.383684 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:18.448373 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:18.523957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1441/2809] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:18 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:18.528140 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.542018 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0b17-9f40-4d38-aff1-aff0cc4f86f2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.564688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:18.602043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.602655 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.602937 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.603210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.603839 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.605868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:18.808255 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1369/2810] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:18 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:18.812929 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.823231 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01dfff-1cd0-4a06-9b61-8363027fac64 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.829070 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.830118 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.830579 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.831041 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.832120 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.835003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:18.854334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1442/2811] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:41:18.859123 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:18.869692 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9bae-26fe-4df5-a541-93c1a3bfcc30 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:18.872683 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:18.875842 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:18.879265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:18.879265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:18.879265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] PATH_INFO: `/v3/projects/f0d50b7b351c47f5a30fe5c46e2cf2c1/users/3f9648012fe1421e830fef829877c3ac/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:18.898202 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d50b7b351c47f5a30fe5c46e2cf2c1, user_id=3f9648012fe1421e830fef829877c3ac, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:18.900999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:19.060033 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1370/2812] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:18 2022] PUT /identity/v3/projects/f0d50b7b351c47f5a30fe5c46e2cf2c1/users/3f9648012fe1421e830fef829877c3ac/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:19.067152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:19.074760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b36d8-bb9f-44d3-ac5c-b25d1a505c55 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:19.140240 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3101-32fa-4757-afc9-4470bfb4227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:19.140910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3101-32fa-4757-afc9-4470bfb4227c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:19.141196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3101-32fa-4757-afc9-4470bfb4227c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:19.141475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3101-32fa-4757-afc9-4470bfb4227c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:19.142125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf3101-32fa-4757-afc9-4470bfb4227c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:19.143763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf3101-32fa-4757-afc9-4470bfb4227c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:19.155504 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1443/2813] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:19.170560 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:19.182210 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30fd4-54ec-4db5-9ba1-b45c2bf3da32 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:19.187145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:19.187827 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:19.188111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:19.188381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] PATH_INFO: `/v3/projects/f0d50b7b351c47f5a30fe5c46e2cf2c1/users/3f9648012fe1421e830fef829877c3ac/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:19.190394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d50b7b351c47f5a30fe5c46e2cf2c1, user_id=3f9648012fe1421e830fef829877c3ac, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:19.193150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:19.208367 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1371/2814] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:19 2022] PUT /identity/v3/projects/f0d50b7b351c47f5a30fe5c46e2cf2c1/users/3f9648012fe1421e830fef829877c3ac/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:19.222106 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:19.222390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:19.222674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:19.258667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] MFA Rules not processed for user `3f9648012fe1421e830fef829877c3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:19.259920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:19.339257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1444/2815] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:19.351957 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:19.353706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:19.421283 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:19.423166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758a45f-8f0d-41d5-890f-d3cba3568b9d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:19.427094 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:19.427768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:19.428069 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:19.428356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:19.439238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:19.440764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:19.452396 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1372/2816] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:21.252585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:21.254133 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:21.267956 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e7646-fa4f-42ee-81da-c96bd4cf56dd None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:21.272141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:21.272872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:21.273037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:21.273302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:21.333588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:21.334952 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:21.345169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1445/2817] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:26.681300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:26.691375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee93ef-17a9-4cc9-af36-3edfb82e69e4 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:26.695261 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40efb8-2491-4b2b-8f7b-3c68d1fa3bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:26.695868 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40efb8-2491-4b2b-8f7b-3c68d1fa3bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:26.696145 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40efb8-2491-4b2b-8f7b-3c68d1fa3bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:26.696417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40efb8-2491-4b2b-8f7b-3c68d1fa3bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:26.755430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40efb8-2491-4b2b-8f7b-3c68d1fa3bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:26.757004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40efb8-2491-4b2b-8f7b-3c68d1fa3bd2 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:26.767029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1373/2818] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:31.340460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=42 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:31.610117 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:31.677101 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594ad6a-ba35-4408-939d-e143a01ee680 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:31.681891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:31.682530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:31.682806 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:31.683083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] PATH_INFO: `/v3/users/3a40c71d0d65455caa1b5964750a3b8a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:31.684273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a40c71d0d65455caa1b5964750a3b8a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:31.686227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:31.936543 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a40c71d0d65455caa1b5964750a3b8a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:31.949198 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a40c71d0d65455caa1b5964750a3b8a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:31.956026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a40c71d0d65455caa1b5964750a3b8a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:31.956752 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a40c71d0d65455caa1b5964750a3b8a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:32.058637 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a40c71d0d65455caa1b5964750a3b8a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:32.064985 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1446/2819] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:31 2022] DELETE /identity/v3/users/3a40c71d0d65455caa1b5964750a3b8a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:32.069518 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:32.069983 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:32.070083 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:32.090643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:32.091877 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:32.106368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:32.285143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1374/2820] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:32.295006 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:32.296410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:32.358014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763c0e-ac08-46ba-aaa6-5ea6fbc392fc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:32.361722 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:32.362328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:32.362611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:32.362901 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:32.372067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:32.373534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:32.383651 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1447/2821] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:32.844384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:32.845932 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:32.861307 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d08dd-5878-4344-9492-71960a8b16f6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:32.863170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:32.863780 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:32.864060 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:32.864330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] PATH_INFO: `/v3/projects/06393b5043d74a7f8ce60460bac72e01` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:32.865494 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06393b5043d74a7f8ce60460bac72e01)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:32.867633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:32.986020 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06393b5043d74a7f8ce60460bac72e01', 'request_id': 'req-545bc80c-354b-4cbd-9130-7400cc2ccdd7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.053183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06393b5043d74a7f8ce60460bac72e01', 'request_id': 'req-545bc80c-354b-4cbd-9130-7400cc2ccdd7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.060436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06393b5043d74a7f8ce60460bac72e01', 'request_id': 'req-545bc80c-354b-4cbd-9130-7400cc2ccdd7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.070984 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] The token cache is being invalidate because project 06393b5043d74a7f8ce60460bac72e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:33.071587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.071906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.073416 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1375/2822] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:32 2022] DELETE /identity/v3/projects/06393b5043d74a7f8ce60460bac72e01 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:33.078102 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:33.088052 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc92a7-5b1f-4342-8670-4906b1987e01 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:33.106800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:33.144975 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:33.145629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:33.146160 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:33.146934 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] PATH_INFO: `/v3/users/f6024bca20cd4384bcfa6585f11ad69b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:33.148194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6024bca20cd4384bcfa6585f11ad69b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:33.150162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:33.354038 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6024bca20cd4384bcfa6585f11ad69b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.365687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6024bca20cd4384bcfa6585f11ad69b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.373113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6024bca20cd4384bcfa6585f11ad69b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.373810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6024bca20cd4384bcfa6585f11ad69b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.487841 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6024bca20cd4384bcfa6585f11ad69b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:33.494638 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1448/2823] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:33 2022] DELETE /identity/v3/users/f6024bca20cd4384bcfa6585f11ad69b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:34.026865 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:34.031954 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:34.041882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc80c-354b-4cbd-9130-7400cc2ccdd7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:34.104444 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:34.105198 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:34.105377 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:34.105652 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] PATH_INFO: `/v3/projects/57f3186013a34b4b9290bbdbc7eab97a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:34.106773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f3186013a34b4b9290bbdbc7eab97a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:34.108740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:34.239389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:34.242898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f3186013a34b4b9290bbdbc7eab97a', 'request_id': 'req-75352dd5-965a-4e29-8757-e2b45800f58e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.338306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f3186013a34b4b9290bbdbc7eab97a', 'request_id': 'req-75352dd5-965a-4e29-8757-e2b45800f58e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.346207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f3186013a34b4b9290bbdbc7eab97a', 'request_id': 'req-75352dd5-965a-4e29-8757-e2b45800f58e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.357365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] The token cache is being invalidate because project 57f3186013a34b4b9290bbdbc7eab97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:34.357831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.358284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.359766 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1376/2824] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:34 2022] DELETE /identity/v3/projects/57f3186013a34b4b9290bbdbc7eab97a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:34.364225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:34.365534 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:34.378429 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf855-a2ec-47c3-9454-a71c5b50b181 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:34.439277 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:34.439906 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:34.440181 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:34.440452 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] PATH_INFO: `/v3/users/3f9648012fe1421e830fef829877c3ac` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:34.442162 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9648012fe1421e830fef829877c3ac)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:34.444073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:34.637227 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:34.639768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9648012fe1421e830fef829877c3ac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.652476 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9648012fe1421e830fef829877c3ac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.659324 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9648012fe1421e830fef829877c3ac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.660039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9648012fe1421e830fef829877c3ac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.836060 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77b2d10e-dead-411f-bf79-ea6c90c77631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9648012fe1421e830fef829877c3ac'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:34.842823 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1449/2825] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:34 2022] DELETE /identity/v3/users/3f9648012fe1421e830fef829877c3ac => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:35.318540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:35.320761 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:35.334366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352dd5-965a-4e29-8757-e2b45800f58e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:35.405214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:35.406985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:35.406985 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:35.407203 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] PATH_INFO: `/v3/projects/f0d50b7b351c47f5a30fe5c46e2cf2c1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:35.409240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d50b7b351c47f5a30fe5c46e2cf2c1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:35.411363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:35.551366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d50b7b351c47f5a30fe5c46e2cf2c1', 'request_id': 'req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:35.647691 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d50b7b351c47f5a30fe5c46e2cf2c1', 'request_id': 'req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:35.654476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d50b7b351c47f5a30fe5c46e2cf2c1', 'request_id': 'req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:35.665226 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] The token cache is being invalidate because project f0d50b7b351c47f5a30fe5c46e2cf2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:35.665525 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:35.666191 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c5f08a5f-55e3-4acd-b01a-bdcfb5ff23fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:35.667716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1377/2826] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:35 2022] DELETE /identity/v3/projects/f0d50b7b351c47f5a30fe5c46e2cf2c1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:35.673842 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:35.674363 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:35.674475 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:35.694732 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:35.695957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:35.760884 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1450/2827] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:35.770368 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:35.770660 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:35.770939 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:35.790706 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:35.791911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:35.800487 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1378/2828] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:35.804746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:35.815657 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522980-9efe-4cb9-9c15-7bd369ee31a7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:35.820557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:35.821199 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:35.821485 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:35.821760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:35.822420 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:41:35.822746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:35.824395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:35.836301 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1451/2829] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:41:35.840970 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:35.851401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e55f-8144-4290-9359-ae6eca0e9dec None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:35.856170 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:35.856781 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:35.857110 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:35.857384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:35.858194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:35.860621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:35.975541 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1379/2830] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:35 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:35.979999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:35.990811 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ee5e-03bf-443b-9ace-a9c6e06283d2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.050580 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.051188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.051473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.051803 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.053300 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.055251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.157828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1452/2831] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:35 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:36.161550 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.173201 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d2bd2-6db6-4ffa-b807-8d56ec35408e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.178331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.178942 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.179222 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.179495 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.180149 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.181876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.192913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1380/2832] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:36.197346 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.207635 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a8ae-09c6-4a55-8ff0-4d724b280b16 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.212302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000208d-b94b-47e6-b9b1-8008000a5bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.212919 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000208d-b94b-47e6-b9b1-8008000a5bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.213201 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000208d-b94b-47e6-b9b1-8008000a5bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.213473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000208d-b94b-47e6-b9b1-8008000a5bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.214110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000208d-b94b-47e6-b9b1-8008000a5bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.215695 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000208d-b94b-47e6-b9b1-8008000a5bf9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.226909 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1453/2833] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:36.231208 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.242422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631640d6-95c5-4579-8d3c-12bd54c07252 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.247229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.247883 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.248168 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.248443 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] PATH_INFO: `/v3/projects/0ca569e916b942abb04ab8ea5426ca40/users/f606e46a374a4be9b4b46b3c92ffea74/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.259926 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:36.263751 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca569e916b942abb04ab8ea5426ca40, user_id=f606e46a374a4be9b4b46b3c92ffea74, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.266661 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.368334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1381/2834] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:36 2022] PUT /identity/v3/projects/0ca569e916b942abb04ab8ea5426ca40/users/f606e46a374a4be9b4b46b3c92ffea74/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:36.438667 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758731-abdf-44b7-aea5-de01e608276b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.438937 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758731-abdf-44b7-aea5-de01e608276b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.439246 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758731-abdf-44b7-aea5-de01e608276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.468539 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-03758731-abdf-44b7-aea5-de01e608276b None None] MFA Rules not processed for user `f606e46a374a4be9b4b46b3c92ffea74`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:36.469791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-03758731-abdf-44b7-aea5-de01e608276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:36.483129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:36.535581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1454/2835] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:36.544258 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.609907 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccbfae-ead2-4a6b-a1dc-255e08a9786f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.614701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.615426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.615629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.615906 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.616538 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.618474 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.758716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1382/2836] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:36 2022] POST /identity/v3/projects => generated 399 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:36.763074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03758731-abdf-44b7-aea5-de01e608276b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.774769 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03758731-abdf-44b7-aea5-de01e608276b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.830907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.831506 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.831785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.832057 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.832692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.834629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.928999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1455/2837] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:36 2022] POST /identity/v3/users => generated 306 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:41:36.933068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.944034 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebb1b-c16f-4eec-8567-cbe08eaee56c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.948838 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.949446 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.949732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.950010 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:36.950683 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:36.952329 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:36.963037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1383/2838] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:36.968361 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:36.978436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ba60-e06d-4bf0-8bd7-42d8c6d1a44f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:36.983064 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:36.984329 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:36.984606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:36.984931 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] PATH_INFO: `/v3/projects/4cb448cc0f6e4d4d93c46744ee17b6af/users/e8e1c86e5b4e4931972861ecc35530d0/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:37.003027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb448cc0f6e4d4d93c46744ee17b6af, user_id=e8e1c86e5b4e4931972861ecc35530d0, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:37.005818 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:37.088319 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1456/2839] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:36 2022] PUT /identity/v3/projects/4cb448cc0f6e4d4d93c46744ee17b6af/users/e8e1c86e5b4e4931972861ecc35530d0/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:37.092386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:37.103273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f338df6-4279-4cff-bde0-f8c7d6002cf0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:37.165073 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f06713-3dd0-4783-a2b1-0f723ef7a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:37.165687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f06713-3dd0-4783-a2b1-0f723ef7a03e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:37.166025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f06713-3dd0-4783-a2b1-0f723ef7a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:37.166231 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f06713-3dd0-4783-a2b1-0f723ef7a03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:37.167543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f06713-3dd0-4783-a2b1-0f723ef7a03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:37.168701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f06713-3dd0-4783-a2b1-0f723ef7a03e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:37.180095 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1384/2840] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:37.184302 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:37.194947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331805b-4bf5-4467-807e-f6280e630ba4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:37.199625 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:37.200299 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:37.200578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:37.200891 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] PATH_INFO: `/v3/projects/4cb448cc0f6e4d4d93c46744ee17b6af/users/e8e1c86e5b4e4931972861ecc35530d0/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:37.202814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb448cc0f6e4d4d93c46744ee17b6af, user_id=e8e1c86e5b4e4931972861ecc35530d0, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:37.205499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:37.216312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1457/2841] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:37 2022] PUT /identity/v3/projects/4cb448cc0f6e4d4d93c46744ee17b6af/users/e8e1c86e5b4e4931972861ecc35530d0/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:37.227326 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:37.227614 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:37.227905 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:37.257947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] MFA Rules not processed for user `e8e1c86e5b4e4931972861ecc35530d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:37.259176 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:37.312365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:37.334415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1385/2842] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:41:37.346183 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:37.347885 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:37.406526 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587df0-22fe-4b3c-b724-c989e8d9ba90 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:37.410311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:37.410908 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:37.411187 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:37.411456 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:37.420734 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:37.422783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:37.433184 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1458/2843] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:37.882029 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:37.894072 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4e309-b1f0-4b51-bc69-4b1d400d8fa3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:37.898009 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89e3f7-667c-4bb5-953d-7aee287db755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:37.898637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e3f7-667c-4bb5-953d-7aee287db755 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:37.898913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e3f7-667c-4bb5-953d-7aee287db755 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:37.899182 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e3f7-667c-4bb5-953d-7aee287db755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:37.960403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89e3f7-667c-4bb5-953d-7aee287db755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:37.961813 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89e3f7-667c-4bb5-953d-7aee287db755 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:37.971742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1386/2844] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:43.931960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:43.945228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:43.997109 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724c292-2a60-424c-bf18-95e1b3ea0b1a service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:44.002191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:44.002819 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:44.003131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:44.003400 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] PATH_INFO: `/v3/users/f606e46a374a4be9b4b46b3c92ffea74` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:44.004517 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f606e46a374a4be9b4b46b3c92ffea74)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:44.006457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:44.554289 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f606e46a374a4be9b4b46b3c92ffea74'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:44.567435 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f606e46a374a4be9b4b46b3c92ffea74'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:44.574674 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f606e46a374a4be9b4b46b3c92ffea74'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:44.575369 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f606e46a374a4be9b4b46b3c92ffea74'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:44.870250 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f606e46a374a4be9b4b46b3c92ffea74'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:44.876755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1459/2845] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:43 2022] DELETE /identity/v3/users/f606e46a374a4be9b4b46b3c92ffea74 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:44.881365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:44.890338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:44.890338 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:44.902374 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:44.903605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:44.963005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1387/2846] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:44.973378 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:44.974814 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:45.032349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc1160-05aa-42b6-b06d-9e2bd746020f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:45.036171 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:45.036783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:45.037091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:45.037368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:45.046865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:45.048313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:45.058603 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1460/2847] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:45.587674 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:45.589221 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:45.602764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a354-aa3d-4cfd-8d4c-6ba5b638ac6b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:45.607604 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:45.609520 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:45.609799 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:45.610417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] PATH_INFO: `/v3/projects/0ca569e916b942abb04ab8ea5426ca40` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:45.611714 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca569e916b942abb04ab8ea5426ca40)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:45.613649 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:45.753179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca569e916b942abb04ab8ea5426ca40', 'request_id': 'req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:45.853513 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca569e916b942abb04ab8ea5426ca40', 'request_id': 'req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:45.861342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca569e916b942abb04ab8ea5426ca40', 'request_id': 'req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:45.872556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] The token cache is being invalidate because project 0ca569e916b942abb04ab8ea5426ca40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:45.872898 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:45.873574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:45.875822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1388/2848] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:45 2022] DELETE /identity/v3/projects/0ca569e916b942abb04ab8ea5426ca40 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:45.879876 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:45.890169 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf0b57-58d9-446e-82e5-ef1360b66ee5 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:45.921591 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:45.948977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:45.949620 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:45.949920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:45.950241 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] PATH_INFO: `/v3/users/e8e1c86e5b4e4931972861ecc35530d0` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:45.951425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e1c86e5b4e4931972861ecc35530d0)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:45.953459 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:46.192957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e1c86e5b4e4931972861ecc35530d0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:46.206518 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e1c86e5b4e4931972861ecc35530d0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:46.213865 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e1c86e5b4e4931972861ecc35530d0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:46.216980 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e1c86e5b4e4931972861ecc35530d0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:46.316288 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-df4a4212-d278-4057-9479-fb6cea4e3327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e1c86e5b4e4931972861ecc35530d0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:46.323072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1461/2849] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:45 2022] DELETE /identity/v3/users/e8e1c86e5b4e4931972861ecc35530d0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:46.798291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:46.799770 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:46.812784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93c2cf-a2ee-4e60-af5d-c45a9c726425 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:46.817355 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:46.872952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:46.873590 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:46.873913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:46.874293 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] PATH_INFO: `/v3/projects/4cb448cc0f6e4d4d93c46744ee17b6af` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:46.875366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb448cc0f6e4d4d93c46744ee17b6af)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:46.877328 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.046418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb448cc0f6e4d4d93c46744ee17b6af', 'request_id': 'req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:47.139007 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb448cc0f6e4d4d93c46744ee17b6af', 'request_id': 'req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:47.147244 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb448cc0f6e4d4d93c46744ee17b6af', 'request_id': 'req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:47.160303 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] The token cache is being invalidate because project 4cb448cc0f6e4d4d93c46744ee17b6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:47.160918 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:47.161381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d4c5e36-5fd2-4a47-9c33-08282f2fbc5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:47.163200 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1389/2850] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:46 2022] DELETE /identity/v3/projects/4cb448cc0f6e4d4d93c46744ee17b6af => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:47.168088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.168376 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.168650 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.189377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:47.190894 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:47.254623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1462/2851] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:47.264054 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.265064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.265823 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.288005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:47.289267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:47.297393 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1390/2852] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:47.302458 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:47.314449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350f37-83e6-4108-a141-0dbb176e57ad None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:47.319203 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:47.319766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.320251 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.320606 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.321354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:41:47.328612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:47.328612 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.336871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1463/2853] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:41:47.341082 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:47.351812 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c73d6-2de8-498f-a2cd-339d6c3048e8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:47.357507 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:47.358316 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.358785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.359120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.360104 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:47.361947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.456449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1391/2854] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:47 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:47.460759 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:47.471836 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9b10-7c72-4bba-94ae-f90debc938db admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:47.515521 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:47.534584 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:47.535222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.535502 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.535781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.536425 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:47.538528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.625664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1464/2855] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:47 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:47.630331 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:47.642360 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798db669-a5d0-4373-b141-2498b81e92fc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:47.647216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:47.647824 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.648106 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.648380 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.649143 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:47.650750 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.663141 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1392/2856] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:41:47.667335 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:47.677861 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d25be4-e4a4-4a62-bcdd-67ad9758a6fa admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:47.682590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28d232-5ee3-4373-9055-333741c0d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:47.683195 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d232-5ee3-4373-9055-333741c0d850 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.683479 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d232-5ee3-4373-9055-333741c0d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.683783 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d232-5ee3-4373-9055-333741c0d850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.684473 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28d232-5ee3-4373-9055-333741c0d850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:47.686097 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28d232-5ee3-4373-9055-333741c0d850 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.697349 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1465/2857] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:47.701693 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:47.713991 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20679fa5-be0e-46b6-aed5-93ef1ca07e9e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:47.718788 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:47.719435 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.719715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.719989 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] PATH_INFO: `/v3/projects/28be394221ed4f808077fdf513475fbe/users/195abbc4c62e46e8b96bf3a3e89b23d7/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.735320 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28be394221ed4f808077fdf513475fbe, user_id=195abbc4c62e46e8b96bf3a3e89b23d7, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:47.749700 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:47.893065 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1393/2858] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:47 2022] PUT /identity/v3/projects/28be394221ed4f808077fdf513475fbe/users/195abbc4c62e46e8b96bf3a3e89b23d7/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:47.903365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:47.903656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:47.904044 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:47.933654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] MFA Rules not processed for user `195abbc4c62e46e8b96bf3a3e89b23d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:47.934947 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:48.001440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1466/2859] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:48.005915 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.040439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:48.067933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0f7a9-fb5c-413b-bcb9-f0af3237a85d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.072666 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.073299 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.073582 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.073858 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.074500 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.076439 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.255287 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1394/2860] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:48 2022] POST /identity/v3/projects => generated 389 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:48.259939 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.270868 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c85c1-3936-4ca5-8c27-6cfd877e0951 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.331761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.332402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.332705 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.333030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.333665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.335617 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.447486 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1467/2861] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:48 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:48.451818 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.462157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57d584-7e1d-499f-b4c5-c2c0c503723c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.466701 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.467296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.468080 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.468354 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.469025 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.470629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.480559 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1395/2862] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:48.486030 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.496272 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f916900-99ca-478c-8f68-579d51e7a626 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.501131 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.501789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.502074 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.502356 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] PATH_INFO: `/v3/projects/22840775b65f42809dcbcb740fd2da4a/users/f113e7bb4989465583a26b7a1a3b80d2/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.518807 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22840775b65f42809dcbcb740fd2da4a, user_id=f113e7bb4989465583a26b7a1a3b80d2, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.521431 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.603082 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1468/2863] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:48 2022] PUT /identity/v3/projects/22840775b65f42809dcbcb740fd2da4a/users/f113e7bb4989465583a26b7a1a3b80d2/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:48.607218 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.617687 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e477be1-73eb-41c1-adef-e231b90bc337 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.679825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201355-6a3b-4678-b5db-be4b8adb5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.680428 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201355-6a3b-4678-b5db-be4b8adb5247 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.680711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201355-6a3b-4678-b5db-be4b8adb5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.681014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201355-6a3b-4678-b5db-be4b8adb5247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.681886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201355-6a3b-4678-b5db-be4b8adb5247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.683557 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201355-6a3b-4678-b5db-be4b8adb5247 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.693782 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1396/2864] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:48.699311 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.710383 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935797a1-201a-49ba-955f-475a212cb9c0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.715537 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.716194 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.716461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.716736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] PATH_INFO: `/v3/projects/22840775b65f42809dcbcb740fd2da4a/users/f113e7bb4989465583a26b7a1a3b80d2/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.719273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22840775b65f42809dcbcb740fd2da4a, user_id=f113e7bb4989465583a26b7a1a3b80d2, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.721936 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.728248 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:48.732692 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1469/2865] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:48 2022] PUT /identity/v3/projects/22840775b65f42809dcbcb740fd2da4a/users/f113e7bb4989465583a26b7a1a3b80d2/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:48.743467 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.743757 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.744032 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.773341 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] MFA Rules not processed for user `f113e7bb4989465583a26b7a1a3b80d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:48.774504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:48.844637 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1397/2866] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:48.856826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:48.858570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:48.919437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60444987-b0f9-43bb-b61f-a04bb9d46a3b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:48.923142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0527-c29f-4ced-97de-046e67e4410d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:48.923755 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0527-c29f-4ced-97de-046e67e4410d service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:48.924108 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0527-c29f-4ced-97de-046e67e4410d service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:48.924402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0527-c29f-4ced-97de-046e67e4410d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:48.933255 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0527-c29f-4ced-97de-046e67e4410d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:48.934675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0527-c29f-4ced-97de-046e67e4410d service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:48.944794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1470/2867] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:49.085120 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:49.115496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:49.147476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5c8a-747b-4413-a3a7-8eac08b8e4bb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:49.152337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:49.153019 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:49.153302 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:49.153607 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] PATH_INFO: `/v3/users/195abbc4c62e46e8b96bf3a3e89b23d7` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:49.154732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195abbc4c62e46e8b96bf3a3e89b23d7)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:49.156685 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:49.341381 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195abbc4c62e46e8b96bf3a3e89b23d7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:49.342056 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195abbc4c62e46e8b96bf3a3e89b23d7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:49.354157 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195abbc4c62e46e8b96bf3a3e89b23d7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:49.361426 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195abbc4c62e46e8b96bf3a3e89b23d7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:49.362223 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195abbc4c62e46e8b96bf3a3e89b23d7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:49.429981 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1398/2868] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:49 2022] DELETE /identity/v3/users/195abbc4c62e46e8b96bf3a3e89b23d7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:49.434601 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:49.439224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:49.439224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:49.454789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:49.455993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:49.515439 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1471/2869] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:49.525846 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:49.527315 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:49.591365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d121f67-4a46-4495-bbc3-0ae1cd961997 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:49.595300 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:49.595848 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:49.596126 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:49.596401 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:49.606408 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:49.607890 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:49.619334 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1399/2870] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:50.164073 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:50.165522 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:50.178633 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3ea96-ed97-43e0-b54f-321f854a7a3c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:50.183436 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:50.184099 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:50.184385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:50.184834 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] PATH_INFO: `/v3/projects/28be394221ed4f808077fdf513475fbe` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:50.186173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28be394221ed4f808077fdf513475fbe)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:50.189905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:50.369689 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28be394221ed4f808077fdf513475fbe', 'request_id': 'req-e4236408-ae86-41de-9adc-33d6b02a1361'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.476152 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28be394221ed4f808077fdf513475fbe', 'request_id': 'req-e4236408-ae86-41de-9adc-33d6b02a1361'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.483150 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28be394221ed4f808077fdf513475fbe', 'request_id': 'req-e4236408-ae86-41de-9adc-33d6b02a1361'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.493843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] The token cache is being invalidate because project 28be394221ed4f808077fdf513475fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:50.494137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.494795 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.496280 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1472/2871] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:50 2022] DELETE /identity/v3/projects/28be394221ed4f808077fdf513475fbe => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:50.500951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:50.511668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa81ea3-4f0d-487e-b9a3-59605d80811e service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:50.563111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:50.573084 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:50.573718 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:50.574001 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:50.574272 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] PATH_INFO: `/v3/users/f113e7bb4989465583a26b7a1a3b80d2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:50.575392 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f113e7bb4989465583a26b7a1a3b80d2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:50.577337 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:50.792070 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f113e7bb4989465583a26b7a1a3b80d2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.792643 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f113e7bb4989465583a26b7a1a3b80d2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.805463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f113e7bb4989465583a26b7a1a3b80d2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.813284 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f113e7bb4989465583a26b7a1a3b80d2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.813951 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-05813de2-cad1-4ce1-a6e7-9b412dda93a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f113e7bb4989465583a26b7a1a3b80d2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:50.915792 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1400/2872] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:50 2022] DELETE /identity/v3/users/f113e7bb4989465583a26b7a1a3b80d2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:51.368609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:51.370088 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:51.384157 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4236408-ae86-41de-9adc-33d6b02a1361 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:51.414308 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:51.457658 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:51.458354 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:51.458634 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:51.458910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] PATH_INFO: `/v3/projects/22840775b65f42809dcbcb740fd2da4a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:51.460037 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22840775b65f42809dcbcb740fd2da4a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:51.461976 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:51.627654 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22840775b65f42809dcbcb740fd2da4a', 'request_id': 'req-d97bdb94-3ce8-4081-b3f2-637f6272fee3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:51.738871 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22840775b65f42809dcbcb740fd2da4a', 'request_id': 'req-d97bdb94-3ce8-4081-b3f2-637f6272fee3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:51.746067 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22840775b65f42809dcbcb740fd2da4a', 'request_id': 'req-d97bdb94-3ce8-4081-b3f2-637f6272fee3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:51.758056 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] The token cache is being invalidate because project 22840775b65f42809dcbcb740fd2da4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:51.758352 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:51.759053 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d97bdb94-3ce8-4081-b3f2-637f6272fee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:51.760677 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1473/2873] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:51 2022] DELETE /identity/v3/projects/22840775b65f42809dcbcb740fd2da4a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:51.766478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:51.766982 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:51.767085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:51.786397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:51.787601 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:51.847771 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1401/2874] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:41:51.857086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:51.857385 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:51.857665 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:51.880130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:51.881338 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:51.889736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1474/2875] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:51.894158 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:51.903778 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b4f6b-b2b2-4bce-a04d-d7f2059e96cd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:51.909195 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:51.909829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:51.910086 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:51.910356 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:51.911005 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:41:51.911403 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:51.913039 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:51.926045 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1402/2876] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:41:51.932389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:51.944988 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2a3d-8151-4a94-bc53-5b53f235e4b4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:51.949761 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:51.950362 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:51.950647 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:51.950926 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:51.951562 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:51.953561 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.065950 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1475/2877] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:51 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:52.070343 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.080716 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e4e5-9144-4c98-bfc5-cf47842fe886 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.132457 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:52.138271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.145870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.145870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.145870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.145870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.145870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.259600 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1403/2878] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:52 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:52.264113 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.275091 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43756ad-14f8-45e1-a54f-bb6c2adc9a5b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.279981 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.280586 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.281550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.281835 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.282483 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.284141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.294905 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1476/2879] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:52.298938 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.308914 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093de2bb-70eb-4e9f-9991-fd822f2a61fa admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.313463 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7464-f492-4edc-9b2b-f76c36c8e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.328330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7464-f492-4edc-9b2b-f76c36c8e506 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.328330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7464-f492-4edc-9b2b-f76c36c8e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.328330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7464-f492-4edc-9b2b-f76c36c8e506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.328330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7464-f492-4edc-9b2b-f76c36c8e506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.328330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7464-f492-4edc-9b2b-f76c36c8e506 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.328330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1404/2880] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:52.332137 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.342313 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e6d9-8cb1-4704-889a-cb957f69bfbf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.347786 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.348442 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.348760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.349083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] PATH_INFO: `/v3/projects/3163aa0f6a384099bdacb859569ab239/users/b7b4d52d21ab4262b641ad4ba11f46b6/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.363631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3163aa0f6a384099bdacb859569ab239, user_id=b7b4d52d21ab4262b641ad4ba11f46b6, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.369165 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.475344 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1477/2881] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:52 2022] PUT /identity/v3/projects/3163aa0f6a384099bdacb859569ab239/users/b7b4d52d21ab4262b641ad4ba11f46b6/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:52.486543 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.486831 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.487144 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.515916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] MFA Rules not processed for user `b7b4d52d21ab4262b641ad4ba11f46b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:52.517160 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:52.582440 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1405/2882] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:52.586996 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.640589 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:52.650877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e21fa-a97e-4015-a9d1-85060953b982 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.655594 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.659920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.659920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.659920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.659920 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.660391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.751081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1478/2883] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:52 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:52.755224 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.766251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242580-4f17-4d07-b912-6c09d03f7c67 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.823784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.824477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.824656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.824965 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.825598 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.827509 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.950238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1406/2884] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:52 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:52.954325 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.965225 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4b78c-16fb-468c-a758-1747474f5dfe admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:52.970693 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:52.971284 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:52.971609 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:52.971899 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:52.972519 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:52.974141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:52.984675 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1479/2885] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:41:52.988578 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:52.998796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d0b1-56c5-42ca-9c48-5158a7987b91 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.003587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356533b-9c34-47c3-acac-66767e279221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.004127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356533b-9c34-47c3-acac-66767e279221 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.004414 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356533b-9c34-47c3-acac-66767e279221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.004688 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356533b-9c34-47c3-acac-66767e279221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.005366 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356533b-9c34-47c3-acac-66767e279221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.007248 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356533b-9c34-47c3-acac-66767e279221 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.018155 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1407/2886] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:53.022366 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.033141 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d24f-e508-461c-90fd-60625962294e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.037756 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.038410 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.038687 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.038960 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] PATH_INFO: `/v3/projects/4074a38ebc63401291554c5955a3393d/users/1aeddf93d49d4334a692ccaba1a55f21/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.055024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4074a38ebc63401291554c5955a3393d, user_id=1aeddf93d49d4334a692ccaba1a55f21, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.057746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.167499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1480/2887] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:53 2022] PUT /identity/v3/projects/4074a38ebc63401291554c5955a3393d/users/1aeddf93d49d4334a692ccaba1a55f21/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:41:53.179207 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.179502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.179784 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.209190 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] MFA Rules not processed for user `1aeddf93d49d4334a692ccaba1a55f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:53.210437 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:53.243412 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:53.276386 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1408/2888] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:53.281220 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.342578 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb774f6-6534-40a5-a62e-faa5544baa85 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.347305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.347910 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.348191 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.348469 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.349142 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.351039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.454965 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1481/2889] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:41:53 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:41:53.459447 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.470493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c780f7-8801-44d9-9d61-e2a84abd970f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.525822 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.526502 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.526731 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.527012 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.527684 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.529644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.630458 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1409/2890] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:41:53 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:41:53.634766 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.645269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92423077-cef3-4678-ab68-fc315a41a7b1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.649879 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.650477 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.650777 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.651039 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.651728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.653365 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.665215 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1482/2891] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:53.669834 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.680482 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f1f59-df99-4fb5-a58f-079e878f5ea2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.685212 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.685897 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.686174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.686449 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] PATH_INFO: `/v3/projects/370f2f8f0a2b46009dbf91dc5ee7a5d8/users/1231c6eeb60d4c7c890fb030e03059fe/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.701371 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370f2f8f0a2b46009dbf91dc5ee7a5d8, user_id=1231c6eeb60d4c7c890fb030e03059fe, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.706063 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.773394 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1410/2892] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:53 2022] PUT /identity/v3/projects/370f2f8f0a2b46009dbf91dc5ee7a5d8/users/1231c6eeb60d4c7c890fb030e03059fe/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:53.777590 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.788211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235643-9318-4255-bdac-16c5f91ddfe7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.848228 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ba18-81ea-4194-b300-5071f8ed0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.848902 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ba18-81ea-4194-b300-5071f8ed0cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.849156 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ba18-81ea-4194-b300-5071f8ed0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.849433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ba18-81ea-4194-b300-5071f8ed0cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.850081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ba18-81ea-4194-b300-5071f8ed0cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.851736 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ba18-81ea-4194-b300-5071f8ed0cc4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.862607 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1483/2893] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:41:53.867109 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:53.878350 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d040e10-6da1-4b12-b8b9-130d5b51aff0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:53.883430 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:53.884085 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.884670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.884670 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] PATH_INFO: `/v3/projects/370f2f8f0a2b46009dbf91dc5ee7a5d8/users/1231c6eeb60d4c7c890fb030e03059fe/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.886841 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=370f2f8f0a2b46009dbf91dc5ee7a5d8, user_id=1231c6eeb60d4c7c890fb030e03059fe, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:53.889973 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:53.902375 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1411/2894] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:41:53 2022] PUT /identity/v3/projects/370f2f8f0a2b46009dbf91dc5ee7a5d8/users/1231c6eeb60d4c7c890fb030e03059fe/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:53.913629 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:53.913940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:53.914232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:53.941463 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:53.944414 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] MFA Rules not processed for user `1231c6eeb60d4c7c890fb030e03059fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:53.945694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:54.016328 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1484/2895] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:54.034917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:54.034917 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:54.091740 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725731a-983a-4054-85ce-07818beb2dff admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:54.096113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:54.098006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:54.098006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:54.098006 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:54.106962 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:54.108563 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:54.119913 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1412/2896] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:54.228598 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:54.230124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:54.242211 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a99e1-d938-413a-96b7-f8285fc85c5c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:54.245888 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ada348-d937-43a5-a9d5-24b415e8dcc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:54.246498 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada348-d937-43a5-a9d5-24b415e8dcc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:54.246780 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada348-d937-43a5-a9d5-24b415e8dcc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:54.247086 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada348-d937-43a5-a9d5-24b415e8dcc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:54.306478 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ada348-d937-43a5-a9d5-24b415e8dcc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:54.307839 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ada348-d937-43a5-a9d5-24b415e8dcc0 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:54.317472 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1485/2897] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:58.452233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:58.482606 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:58.514342 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3976e-2e7b-4a23-a42d-811148007f0c service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:58.519133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:58.519764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:58.520051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:58.520324 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] PATH_INFO: `/v3/users/b7b4d52d21ab4262b641ad4ba11f46b6` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:58.521468 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b4d52d21ab4262b641ad4ba11f46b6)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:58.523369 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:58.700671 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b4d52d21ab4262b641ad4ba11f46b6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:58.701351 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b4d52d21ab4262b641ad4ba11f46b6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:58.713562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b4d52d21ab4262b641ad4ba11f46b6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:58.721013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b4d52d21ab4262b641ad4ba11f46b6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:58.724055 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b4d52d21ab4262b641ad4ba11f46b6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:58.830911 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1413/2898] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:58 2022] DELETE /identity/v3/users/b7b4d52d21ab4262b641ad4ba11f46b6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:58.835623 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:58.836104 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:58.836204 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:58.855775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:58.857031 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:58.916664 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1486/2899] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:58.927271 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:58.929077 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:58.997596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5fc9-304e-4735-b1a1-ea1f621bd3e6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:58.997596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:58.997596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:58.997596 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:58.998476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:59.004150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:59.005616 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:59.015382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1414/2900] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:41:59.443941 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:59.445659 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:59.461017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8663d-e273-42da-9a58-6f6169f7b1d8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:59.466027 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:59.466671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:59.466944 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:59.467588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] PATH_INFO: `/v3/projects/3163aa0f6a384099bdacb859569ab239` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:59.468948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3163aa0f6a384099bdacb859569ab239)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:59.470789 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:59.556278 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:59.568147 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3163aa0f6a384099bdacb859569ab239', 'request_id': 'req-503487e9-4da2-44b0-8f77-396ca5a38961'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.642066 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3163aa0f6a384099bdacb859569ab239', 'request_id': 'req-503487e9-4da2-44b0-8f77-396ca5a38961'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.649224 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3163aa0f6a384099bdacb859569ab239', 'request_id': 'req-503487e9-4da2-44b0-8f77-396ca5a38961'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.660413 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] The token cache is being invalidate because project 3163aa0f6a384099bdacb859569ab239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:41:59.660710 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.661391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.662867 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1487/2901] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:41:59 2022] DELETE /identity/v3/projects/3163aa0f6a384099bdacb859569ab239 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:59.669229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:41:59.677357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100b89-8caf-40b8-aacc-f525f0ba0719 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:41:59.727049 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:59.736901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:41:59.737539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:59.737852 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:59.738125 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] PATH_INFO: `/v3/users/1aeddf93d49d4334a692ccaba1a55f21` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:59.739240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aeddf93d49d4334a692ccaba1a55f21)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:41:59.741177 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:41:59.969956 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aeddf93d49d4334a692ccaba1a55f21'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.970621 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aeddf93d49d4334a692ccaba1a55f21'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.982644 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aeddf93d49d4334a692ccaba1a55f21'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.990183 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aeddf93d49d4334a692ccaba1a55f21'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:41:59.990857 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aeddf93d49d4334a692ccaba1a55f21'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:00.063574 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1415/2902] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:41:59 2022] DELETE /identity/v3/users/1aeddf93d49d4334a692ccaba1a55f21 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:00.586793 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:00.588390 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:00.601781 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503487e9-4da2-44b0-8f77-396ca5a38961 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:00.662556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:00.663196 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:00.663482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:00.663760 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] PATH_INFO: `/v3/projects/4074a38ebc63401291554c5955a3393d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:00.665364 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4074a38ebc63401291554c5955a3393d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:00.666882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:00.808655 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4074a38ebc63401291554c5955a3393d', 'request_id': 'req-0f49d259-9f94-404d-ad15-a75f46ccd01d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:00.898450 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4074a38ebc63401291554c5955a3393d', 'request_id': 'req-0f49d259-9f94-404d-ad15-a75f46ccd01d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:00.905628 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4074a38ebc63401291554c5955a3393d', 'request_id': 'req-0f49d259-9f94-404d-ad15-a75f46ccd01d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:00.916897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] The token cache is being invalidate because project 4074a38ebc63401291554c5955a3393d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:42:00.917193 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:00.917843 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:00.919371 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1488/2903] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:42:00 2022] DELETE /identity/v3/projects/4074a38ebc63401291554c5955a3393d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:00.923551 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:00.925752 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:00.939023 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe492a-13eb-4707-935d-e6669e714ceb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:00.997128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:00.997773 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:00.998053 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:00.998332 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] PATH_INFO: `/v3/users/1231c6eeb60d4c7c890fb030e03059fe` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:00.999475 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1231c6eeb60d4c7c890fb030e03059fe)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:01.001632 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:01.186723 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1231c6eeb60d4c7c890fb030e03059fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:01.187330 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1231c6eeb60d4c7c890fb030e03059fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:01.199514 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1231c6eeb60d4c7c890fb030e03059fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:01.204825 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:01.206779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1231c6eeb60d4c7c890fb030e03059fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:01.207477 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e044de8f-7151-42b7-acc3-bcafd2790c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1231c6eeb60d4c7c890fb030e03059fe'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:01.327209 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1416/2904] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:42:00 2022] DELETE /identity/v3/users/1231c6eeb60d4c7c890fb030e03059fe => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:01.832293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:01.833854 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:01.847592 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49d259-9f94-404d-ad15-a75f46ccd01d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:01.896267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:01.905758 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:01.906391 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:01.906671 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:01.906948 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] PATH_INFO: `/v3/projects/370f2f8f0a2b46009dbf91dc5ee7a5d8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:01.908110 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370f2f8f0a2b46009dbf91dc5ee7a5d8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:01.910907 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.047509 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370f2f8f0a2b46009dbf91dc5ee7a5d8', 'request_id': 'req-cd0e6576-57ee-4afc-ba08-fcb77cbda720'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:02.138440 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370f2f8f0a2b46009dbf91dc5ee7a5d8', 'request_id': 'req-cd0e6576-57ee-4afc-ba08-fcb77cbda720'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:02.146016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370f2f8f0a2b46009dbf91dc5ee7a5d8', 'request_id': 'req-cd0e6576-57ee-4afc-ba08-fcb77cbda720'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:02.157810 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] The token cache is being invalidate because project 370f2f8f0a2b46009dbf91dc5ee7a5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:42:02.158164 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:02.158847 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cd0e6576-57ee-4afc-ba08-fcb77cbda720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:02.161024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1489/2905] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:42:01 2022] DELETE /identity/v3/projects/370f2f8f0a2b46009dbf91dc5ee7a5d8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:02.166656 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.167159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.167265 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.186668 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:02.187870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:02.249289 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1417/2906] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:42:02.258630 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.258924 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.259200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.279805 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:02.281072 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:02.289092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1490/2907] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:42:02.297485 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:02.307807 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f1d13-78df-4cef-afb5-3c1399aa503e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:02.312407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:02.313127 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.313411 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.313689 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.314830 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:42:02.315137 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:02.316876 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.329194 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1418/2908] 10.222.0.76 () {58 vars in 1153 bytes} [Wed Aug 31 19:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:42:02.334381 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:02.343828 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee47e5-a884-480c-878f-ae38538e1f0e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:02.348673 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:02.351791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.351791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.351791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.351791 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:02.352530 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.449257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1491/2909] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:42:02 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:42:02.453415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:02.463958 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a402d8-994b-497a-9a20-c93f8b1131a2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:02.520453 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:02.521101 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.521389 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.521667 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.522305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:02.524233 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.642199 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1419/2910] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:42:02 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:42:02.646808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:02.657573 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1800cb-9d72-4059-82ab-f13304c76e3a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:02.662999 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:02.663748 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.663916 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.664192 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.664977 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:02.666685 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.677611 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1492/2911] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:42:02.681779 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:02.691901 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147954-de75-4e05-b1c8-bcf86559d035 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:02.696849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de1b3-096f-4c1f-9294-6cb5a982a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:02.697452 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de1b3-096f-4c1f-9294-6cb5a982a910 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.697732 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de1b3-096f-4c1f-9294-6cb5a982a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.698004 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de1b3-096f-4c1f-9294-6cb5a982a910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.698648 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9de1b3-096f-4c1f-9294-6cb5a982a910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:02.700364 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9de1b3-096f-4c1f-9294-6cb5a982a910 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.712922 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1420/2912] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:42:02.717239 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:02.727815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be2af4-4dbc-4b8b-8406-ec8b108411b0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:02.732445 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:02.733130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.733457 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.733740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] PATH_INFO: `/v3/projects/89dbc8a1b7f6480d9cff0f95e6f13d01/users/e9ecd4182b80482eb795aaa7250be5cb/roles/30e479ab3dee4ac3aeb96b4eb87bb666` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.748334 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89dbc8a1b7f6480d9cff0f95e6f13d01, user_id=e9ecd4182b80482eb795aaa7250be5cb, role_id=30e479ab3dee4ac3aeb96b4eb87bb666)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:02.751048 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:02.887963 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1493/2913] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:42:02 2022] PUT /identity/v3/projects/89dbc8a1b7f6480d9cff0f95e6f13d01/users/e9ecd4182b80482eb795aaa7250be5cb/roles/30e479ab3dee4ac3aeb96b4eb87bb666 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:02.901002 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:02.901291 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:02.901568 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:02.929113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] MFA Rules not processed for user `e9ecd4182b80482eb795aaa7250be5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:02.930306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:02.974787 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:02.995814 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1421/2914] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:42:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:42:03.000449 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.066200 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3212-1c61-4ffc-8fb9-1be414ead0f3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.071100 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.071707 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.071990 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.072269 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.072942 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.074849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.193232 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1494/2915] 10.222.0.76 () {60 vars in 1153 bytes} [Wed Aug 31 19:42:02 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:42:03.198478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.209908 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9caf2e-287b-40b5-8184-cb98e95f125c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.271996 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.272703 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.273113 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.273517 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.274275 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.276456 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.408633 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1422/2916] 10.222.0.76 () {60 vars in 1144 bytes} [Wed Aug 31 19:42:03 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:42:03.412982 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.418698 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:03.424763 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a75a73-3ef9-4056-b2dc-025c557f2bbf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.429877 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.430520 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.430799 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.431078 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.431725 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.433355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.446083 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1495/2917] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:42:03.450592 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.461398 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca251-edb4-4770-a7aa-32afbc909e86 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.466539 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.467214 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.467496 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.467772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] PATH_INFO: `/v3/projects/bfcf84f238fb4501b53eff96fc0c3517/users/9b22ad515f594d0a8c359bcc3022dd70/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.483795 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcf84f238fb4501b53eff96fc0c3517, user_id=9b22ad515f594d0a8c359bcc3022dd70, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.487092 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.579756 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1423/2918] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:42:03 2022] PUT /identity/v3/projects/bfcf84f238fb4501b53eff96fc0c3517/users/9b22ad515f594d0a8c359bcc3022dd70/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:03.584496 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.595135 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9353be6-71bd-479c-8aad-156e3cc02e26 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.658386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32af5a-d7cd-4f27-9953-d8ed3018c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.658386 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32af5a-d7cd-4f27-9953-d8ed3018c638 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.658882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32af5a-d7cd-4f27-9953-d8ed3018c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.658882 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32af5a-d7cd-4f27-9953-d8ed3018c638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.659604 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32af5a-d7cd-4f27-9953-d8ed3018c638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.661252 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32af5a-d7cd-4f27-9953-d8ed3018c638 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.671528 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1496/2919] 10.222.0.76 () {58 vars in 1122 bytes} [Wed Aug 31 19:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:42:03.675952 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.687296 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824e6f9-9e63-4e19-87bb-fa2068486476 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.692959 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.693624 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.693902 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.694174 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] PATH_INFO: `/v3/projects/bfcf84f238fb4501b53eff96fc0c3517/users/9b22ad515f594d0a8c359bcc3022dd70/roles/a3733baec72d443ab044f15928e9f85d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.696694 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcf84f238fb4501b53eff96fc0c3517, user_id=9b22ad515f594d0a8c359bcc3022dd70, role_id=a3733baec72d443ab044f15928e9f85d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.699419 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.711425 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1424/2920] 10.222.0.76 () {60 vars in 1483 bytes} [Wed Aug 31 19:42:03 2022] PUT /identity/v3/projects/bfcf84f238fb4501b53eff96fc0c3517/users/9b22ad515f594d0a8c359bcc3022dd70/roles/a3733baec72d443ab044f15928e9f85d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:03.721833 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.722143 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.722468 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.760112 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] MFA Rules not processed for user `9b22ad515f594d0a8c359bcc3022dd70`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:03.761389 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:03.840322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1497/2921] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:42:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:42:03.852583 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.854641 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:03.915764 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073bbf0-5a95-4e21-baff-d52ec57955b8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.919397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefecea-eeda-4124-b4e6-146a34e6c410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50774a4923ce4027a7c36d9972e53e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.919999 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefecea-eeda-4124-b4e6-146a34e6c410 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.920277 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefecea-eeda-4124-b4e6-146a34e6c410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.920548 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefecea-eeda-4124-b4e6-146a34e6c410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.971595 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:03.981253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefecea-eeda-4124-b4e6-146a34e6c410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.982702 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefecea-eeda-4124-b4e6-146a34e6c410 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.993278 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1425/2922] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:07.445775 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:07.508377 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f11ff-eef7-4c1a-835a-c66e9f9832f8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:07.512983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:07.513613 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:07.513892 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:07.514163 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] PATH_INFO: `/v3/users/e9ecd4182b80482eb795aaa7250be5cb` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:07.515312 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ecd4182b80482eb795aaa7250be5cb)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:07.517978 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:07.532774 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:07.752273 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ecd4182b80482eb795aaa7250be5cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:07.764785 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ecd4182b80482eb795aaa7250be5cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:07.772267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ecd4182b80482eb795aaa7250be5cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:07.773024 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ecd4182b80482eb795aaa7250be5cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:07.852402 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ecd4182b80482eb795aaa7250be5cb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:07.858542 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1498/2923] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:42:07 2022] DELETE /identity/v3/users/e9ecd4182b80482eb795aaa7250be5cb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:07.863171 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:07.863654 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:07.863774 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:07.883305 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] MFA Rules not processed for user `2bdffc3106dc45bebf612cd563b7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:07.884540 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:07.943014 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1426/2924] 10.222.0.76 () {58 vars in 958 bytes} [Wed Aug 31 19:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:42:07.952686 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:07.954136 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:08.013983 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35cc6-c960-41ee-8526-c6a8e941cac8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:08.018206 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:08.018845 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:08.019132 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:08.019408 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:08.028322 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:08.029778 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:08.039028 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1499/2925] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:08.522079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:08.523515 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:08.536166 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8d84f-f7eb-4342-aa0e-e06018c4510b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:08.545695 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:08.546436 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:08.546725 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:08.547107 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] PATH_INFO: `/v3/projects/89dbc8a1b7f6480d9cff0f95e6f13d01` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:08.549057 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89dbc8a1b7f6480d9cff0f95e6f13d01)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:08.551322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:08.670384 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89dbc8a1b7f6480d9cff0f95e6f13d01', 'request_id': 'req-32567015-609a-4f12-b6b3-7ec1428cd38a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:08.766910 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89dbc8a1b7f6480d9cff0f95e6f13d01', 'request_id': 'req-32567015-609a-4f12-b6b3-7ec1428cd38a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:08.774013 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89dbc8a1b7f6480d9cff0f95e6f13d01', 'request_id': 'req-32567015-609a-4f12-b6b3-7ec1428cd38a'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:08.785192 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] The token cache is being invalidate because project 89dbc8a1b7f6480d9cff0f95e6f13d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:42:08.785417 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:08.786064 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:08.787640 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1427/2926] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:42:08 2022] DELETE /identity/v3/projects/89dbc8a1b7f6480d9cff0f95e6f13d01 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:08.791730 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:08.802433 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514e23-ea1d-43b6-bf3e-2d349442b36a service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:08.869437 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:08.870076 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:08.870395 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:08.870670 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] PATH_INFO: `/v3/users/9b22ad515f594d0a8c359bcc3022dd70` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:08.871815 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b22ad515f594d0a8c359bcc3022dd70)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:08.873804 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:09.099550 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:09.113173 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b22ad515f594d0a8c359bcc3022dd70'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.126017 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b22ad515f594d0a8c359bcc3022dd70'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.133222 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b22ad515f594d0a8c359bcc3022dd70'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.134768 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b22ad515f594d0a8c359bcc3022dd70'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.224178 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b22ad515f594d0a8c359bcc3022dd70'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.230746 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1500/2927] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:42:08 2022] DELETE /identity/v3/users/9b22ad515f594d0a8c359bcc3022dd70 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:09.677729 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:09.679216 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:09.702036 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567015-609a-4f12-b6b3-7ec1428cd38a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:09.754672 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:09.755317 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:09.755605 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:09.755886 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] PATH_INFO: `/v3/projects/bfcf84f238fb4501b53eff96fc0c3517` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:09.757556 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcf84f238fb4501b53eff96fc0c3517)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:09.759775 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:09.777785 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:09.910587 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcf84f238fb4501b53eff96fc0c3517', 'request_id': 'req-a95adf98-b671-4a68-84fa-c44a43c17f87'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.991037 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcf84f238fb4501b53eff96fc0c3517', 'request_id': 'req-a95adf98-b671-4a68-84fa-c44a43c17f87'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:09.998273 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcf84f238fb4501b53eff96fc0c3517', 'request_id': 'req-a95adf98-b671-4a68-84fa-c44a43c17f87'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:10.010418 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] The token cache is being invalidate because project bfcf84f238fb4501b53eff96fc0c3517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:42:10.010711 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:10.011363 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:42:10.012899 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1428/2928] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:42:09 2022] DELETE /identity/v3/projects/bfcf84f238fb4501b53eff96fc0c3517 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:42:19.504305 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:20.007522 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:39.581912 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:39.583393 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:39.649014 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38a895-9b6b-4fea-9351-b0b8016ee5c4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:39.698957 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:39.699566 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:39.699849 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:39.700125 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:39.701897 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:39.774318 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:39.775728 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:39.787699 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1501/2929] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:40.980197 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:40.981722 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:40.997128 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95adf98-b671-4a68-84fa-c44a43c17f87 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:41.000742 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:41.001365 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:41.001646 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:41.001927 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:41.003625 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:41.019282 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:41.020698 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:41.031612 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1429/2930] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:48.819511 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:48.821026 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:48.832111 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62465127-9bd5-4919-b586-304a8d5bb802 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:48.836294 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:48.836993 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:48.837281 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:48.837556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:48.839551 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:48.850656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:48.852105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581104a1-8ceb-4027-a997-7c7a1d566104 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:48.862935 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1502/2931] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:51.026832 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:53.056933 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:53.066238 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aede310-ee6f-4779-9858-c033ab90411e service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:53.069882 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:53.071251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:53.071251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:53.071251 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:53.072710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:53.082454 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:53.083866 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf62083-061a-4875-9e7f-992df6bb5400 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:53.092382 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1430/2932] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:42:53.780253 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7e19-5d02-4378-bf75-4ff35b5d010a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:53.781751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7e19-5d02-4378-bf75-4ff35b5d010a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:53.781751 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7e19-5d02-4378-bf75-4ff35b5d010a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:53.782267 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1503/2933] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:42:53.788336 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99745b96-6177-4514-bee3-3afdd01b3f1c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:53.788619 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99745b96-6177-4514-bee3-3afdd01b3f1c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:53.788925 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99745b96-6177-4514-bee3-3afdd01b3f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:53.838306 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-99745b96-6177-4514-bee3-3afdd01b3f1c None None] MFA Rules not processed for user `6a237c4387a84af784b3c0ca921841f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:53.839584 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-99745b96-6177-4514-bee3-3afdd01b3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:53.846169 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1431/2934] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:42:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:42:53.859387 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac7e19-5d02-4378-bf75-4ff35b5d010a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:53.871260 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac7e19-5d02-4378-bf75-4ff35b5d010a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:53.875019 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea297c05-4632-4ea8-b425-b95cc1a3f7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:53.875588 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297c05-4632-4ea8-b425-b95cc1a3f7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:53.875873 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297c05-4632-4ea8-b425-b95cc1a3f7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:53.876207 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297c05-4632-4ea8-b425-b95cc1a3f7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:53.884270 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea297c05-4632-4ea8-b425-b95cc1a3f7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:53.885767 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea297c05-4632-4ea8-b425-b95cc1a3f7a2 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:53.893848 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1504/2935] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:53.981311 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b237c6-19b1-4ef1-9ca5-fd1440864cda None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:53.981603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b237c6-19b1-4ef1-9ca5-fd1440864cda None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:53.981885 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b237c6-19b1-4ef1-9ca5-fd1440864cda None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:53.983240 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1432/2936] 10.222.0.76 () {54 vars in 921 bytes} [Wed Aug 31 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:42:53.988129 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:53.988417 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:53.988694 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:54.028046 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] MFA Rules not processed for user `0257d1031cbe49f0b2565286946ec6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:42:54.029243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:54.038970 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1505/2937] 10.222.0.76 () {58 vars in 1018 bytes} [Wed Aug 31 19:42:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:42:54.050397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b237c6-19b1-4ef1-9ca5-fd1440864cda None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:54.061916 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b237c6-19b1-4ef1-9ca5-fd1440864cda None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:54.065553 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a237c4387a84af784b3c0ca921841f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:54.066150 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:54.066432 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:54.066705 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:54.077422 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:54.078863 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:54.090262 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1433/2938] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:54.152826 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:54.154355 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:54.168105 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:54.223170 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae761d9-8d26-4da2-bc8c-ca70f0d5299d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:54.229116 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:54.229731 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:54.230016 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:54.230297 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:54.232080 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:54.245510 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:54.247188 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:54.257808 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1506/2939] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:55.569745 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:55.571267 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:55.586697 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742641-4792-4cd0-a37a-5033af6cf979 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:55.592528 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:55.593159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:55.593476 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:55.594051 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:55.595431 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:55.608715 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:55.610415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:55.621205 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1434/2940] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:43:04.253034 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=27 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:05.616512 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=31 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:17.891740 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:17.905527 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9517e-a5a5-4ec6-bb25-fb2e4b657690 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:17.911558 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0257d1031cbe49f0b2565286946ec6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:17.912581 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:17.912979 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:17.913872 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:17.915971 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:17.930821 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:17.932460 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:17.944688 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1507/2941] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:44:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:44:26.717727 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:26.729333 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2355bd-40b2-4a66-b693-056d6afbb5af service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:26.734510 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:26.735079 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:26.735357 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:26.735629 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:26.737493 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:26.749798 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:26.751562 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:26.762765 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1435/2942] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:44:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:44:27.939368 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:30.438081 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:30.450499 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4fe7-b21e-42c2-bca0-9aadc835f47e service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:30.455556 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:30.456168 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:30.456482 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:30.456737 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:30.458574 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:30.472092 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:30.473790 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:30.484577 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1508/2943] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:44:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:44:30.591253 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:30.592768 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:30.657845 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3ba32-d1cd-46de-8f2f-9fd8a9e3ee7d service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:30.662322 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:30.662947 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:30.663229 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:30.663504 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] PATH_INFO: `/v3/users/4a94df8154af4c8f937b97d8e683d21c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:30.664611 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a94df8154af4c8f937b97d8e683d21c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:30.666566 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:30.849043 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a94df8154af4c8f937b97d8e683d21c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:30.849710 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a94df8154af4c8f937b97d8e683d21c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:30.861826 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a94df8154af4c8f937b97d8e683d21c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:30.869415 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a94df8154af4c8f937b97d8e683d21c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:30.870071 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a94df8154af4c8f937b97d8e683d21c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:30.960478 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1436/2944] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:44:30 2022] DELETE /identity/v3/users/4a94df8154af4c8f937b97d8e683d21c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:44:31.228874 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:31.242593 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8278e-add5-433e-b4e1-a4e05ae7c3d8 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:31.303003 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:31.303656 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:31.303940 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:31.304219 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] PATH_INFO: `/v3/projects/e617bf9591ec41c6881c443d91414528` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:31.305394 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e617bf9591ec41c6881c443d91414528)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:31.307474 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:31.418293 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e617bf9591ec41c6881c443d91414528', 'request_id': 'req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.478130 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e617bf9591ec41c6881c443d91414528', 'request_id': 'req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.485245 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e617bf9591ec41c6881c443d91414528', 'request_id': 'req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.496124 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] The token cache is being invalidate because project e617bf9591ec41c6881c443d91414528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:44:31.496419 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.497208 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.498794 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1509/2945] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:44:31 2022] DELETE /identity/v3/projects/e617bf9591ec41c6881c443d91414528 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:44:31.503179 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:31.504555 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:31.518772 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab373-5e9f-40bd-88fb-3642d8cbc868 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:31.579215 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:31.579849 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:31.580133 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:31.580407 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] PATH_INFO: `/v3/users/0125265ed89349ff88bdd826c575c6bb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:31.581549 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0125265ed89349ff88bdd826c575c6bb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:31.583567 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:31.588878 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:31.821397 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0125265ed89349ff88bdd826c575c6bb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.822068 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0125265ed89349ff88bdd826c575c6bb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.834796 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0125265ed89349ff88bdd826c575c6bb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.843132 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0125265ed89349ff88bdd826c575c6bb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.843856 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0125265ed89349ff88bdd826c575c6bb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:31.964089 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1437/2946] 10.222.0.76 () {58 vars in 1224 bytes} [Wed Aug 31 19:44:31 2022] DELETE /identity/v3/users/0125265ed89349ff88bdd826c575c6bb => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:44:32.202765 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:32.204257 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:32.218585 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb0c0-ddf6-40c0-87d6-f910dd3bf384 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:32.286557 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bdffc3106dc45bebf612cd563b7955e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c50ebd1d38a64d4a92701ba8958dbdd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:32.287243 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:32.287575 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:32.288380 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] PATH_INFO: `/v3/projects/edfd7bcebfda4dc4a9ec07402254624e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:32.289602 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfd7bcebfda4dc4a9ec07402254624e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:32.291570 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:32.312631 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:32.423186 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfd7bcebfda4dc4a9ec07402254624e', 'request_id': 'req-6ebef776-b1d6-4af1-a614-429659d99d9d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:32.508750 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfd7bcebfda4dc4a9ec07402254624e', 'request_id': 'req-6ebef776-b1d6-4af1-a614-429659d99d9d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:32.514359 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfd7bcebfda4dc4a9ec07402254624e', 'request_id': 'req-6ebef776-b1d6-4af1-a614-429659d99d9d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:32.525505 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] The token cache is being invalidate because project edfd7bcebfda4dc4a9ec07402254624e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:44:32.525800 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:32.526461 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6ebef776-b1d6-4af1-a614-429659d99d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:44:32.527951 dv-cinder-835384-26-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1510/2947] 10.222.0.76 () {58 vars in 1233 bytes} [Wed Aug 31 19:44:32 2022] DELETE /identity/v3/projects/edfd7bcebfda4dc4a9ec07402254624e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:44:41.960870 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:42.521801 dv-cinder-835384-26-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:48.225017 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:48.226448 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:48.298953 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e82d6-8471-4c14-8fba-d24a23ef5436 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:48.364111 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c69df95a434fdeb5737455ba226320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89c9d5d178204282a68c68b1dc416291', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:48.364819 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:48.365139 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:48.365508 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:48.368738 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:48.381159 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:48.382829 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103dab7-2fee-497f-963d-a30a0df15b42 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:48.393603 dv-cinder-835384-26-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1438/2948] 10.222.0.76 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:58.388492 dv-cinder-835384-26-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=58 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}